vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #360
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.XA94QCHybq', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 56b7def1-4b9e-422e-8124-6d5c4449629d16gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20gitlab # Writing inode tables: 0/8 done21(finished: start all VMs, in 102.85 seconds)22gitlab # Creating journal (8192 blocks): done23gitlab # Writing superblocks and filesystem accounting information: 0/8 done24gitlab # 25gitlab # Virtualisation disk image created.26gitlab # Creating Nix store image...27gitlab # Created Nix store image.28gitlab: waiting for unit setup-gitlab.service29gitlab: waiting for the VM to finish booting30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/f6ljkhhmp1hk802y8g79843ykx77rkxf-nixos-system-gitlab-test/init regInfo=/nix/store/csnlkvl04fyx3n3chw7m55b79whminj2-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000001] kvm-clock: using sched offset of 532835541 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.010 MHz processor67gitlab # [ 0.000813] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000879] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002776] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002788] Using GB pages for direct mapping73gitlab # [ 0.002861] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002867] ACPI: Early table checksum verification disabled75gitlab # [ 0.002871] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002875] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002879] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002887] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002889] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002891] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002892] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002894] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002895] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002896] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002897] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002897] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002898] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002898] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003120] No NUMA configuration found90gitlab # [ 0.003121] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003124] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005477] Zone ranges:93gitlab # [ 0.005478] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005479] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005480] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005481] Device empty97gitlab # [ 0.005482] Movable zone start for each node98gitlab # [ 0.005483] Early memory node ranges99gitlab # [ 0.005483] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005484] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005485] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005486] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005509] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005791] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.120995] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.121438] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.121455] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.121495] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.121498] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.121499] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.121501] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.121502] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.121502] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.121505] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.121506] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.121512] TSC deadline timer available117gitlab # [ 0.121517] CPU topo: Max. logical packages: 1118gitlab # [ 0.121518] CPU topo: Max. logical dies: 1119gitlab # [ 0.121518] CPU topo: Max. dies per package: 1120gitlab # [ 0.121521] CPU topo: Max. threads per core: 1121gitlab # [ 0.121522] CPU topo: Num. cores per package: 4122gitlab # [ 0.121522] CPU topo: Num. threads per package: 4123gitlab # [ 0.121523] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.121548] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.121566] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.121569] kvm-guest: setup PV sched yield127gitlab # [ 0.121585] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.121587] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.121588] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.121596] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.121598] Booting paravirtualized kernel on KVM132gitlab # [ 0.121602] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.126085] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.128927] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.128984] kvm-guest: PV spinlocks enabled136gitlab # [ 0.128986] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.128989] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/f6ljkhhmp1hk802y8g79843ykx77rkxf-nixos-system-gitlab-test/init regInfo=/nix/store/csnlkvl04fyx3n3chw7m55b79whminj2-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.129089] Unknown kernel command line parameters "regInfo=/nix/store/csnlkvl04fyx3n3chw7m55b79whminj2-closure-info/registration", will be passed to user space.139gitlab # [ 0.129103] random: crng init done140gitlab # [ 0.129104] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.138625] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.143135] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.143215] software IO TLB: area num 4.144gitlab # [ 0.222752] Fallback order for Node 0: 0145gitlab # [ 0.222761] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.222763] Policy zone: Normal147gitlab # [ 0.225948] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.236412] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.250712] allocated 12582912 bytes of page_ext150gitlab # [ 0.261033] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.261035] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.261909] Dynamic Preempt: lazy153gitlab # [ 0.262105] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.262106] rcu: RCU event tracing is enabled.155gitlab # [ 0.262107] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.262108] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.262109] Rude variant of Tasks RCU enabled.158gitlab # [ 0.262109] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.262110] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.262111] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.262142] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.262144] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.262145] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.266964] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.267287] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.267296] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.267413] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.270998] Console: colour VGA+ 80x25169gitlab # [ 0.271001] printk: legacy console [tty0] enabled170gitlab # [ 0.301265] printk: legacy console [ttyS0] enabled171gitlab # [ 0.411608] ACPI: Core revision 20250807172gitlab # [ 0.412531] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.414277] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.415383] x2apic enabled175gitlab # [ 0.416219] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.417353] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.418618] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.420113] kvm-guest: setup PV IPIs179gitlab # [ 0.421828] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.422883] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns181gitlab # [ 0.424663] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010)182gitlab # [ 0.425748] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.427783] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.429660] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.430664] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.432660] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.433661] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.435660] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.436661] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.437660] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.438670] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.439662] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.440661] active return thunk: srso_alias_return_thunk194gitlab # [ 0.442390] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.443660] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.444660] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.445660] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.446660] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.447660] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.448660] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.449660] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.451458] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.452475] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.453465] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.454471] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.455457] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.485834] Freeing SMP alternatives memory: 44K208gitlab # [ 0.486663] pid_max: default: 32768 minimum: 301209gitlab # [ 0.487551] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.488759] landlock: Up and running.211gitlab # [ 0.489406] Yama: becoming mindful.212gitlab # [ 0.489872] LSM support for eBPF active213gitlab # [ 0.490895] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.492679] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.495153] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.496300] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.496669] ... version: 2218gitlab # [ 0.497434] ... bit width: 48219gitlab # [ 0.497662] ... generic counters: 6220gitlab # [ 0.498401] ... generic bitmap: 000000000000003f221gitlab # [ 0.498663] ... fixed-purpose counters: 0222gitlab # [ 0.499459] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.500426] ... value mask: 0000ffffffffffff224gitlab # [ 0.500663] ... max period: 00007fffffffffff225gitlab # [ 0.501633] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.502561] signal: max sigframe size: 3376227gitlab # [ 0.503746] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.504634] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.505582] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.511394] smp: Bringing up secondary CPUs ...231gitlab # [ 0.512085] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.512668] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.515761] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.517393] smpboot: Total of 4 processors activated (19200.08 BogoMIPS)235gitlab # [ 0.517941] Memory: 6011548K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.519096] devtmpfs: initialized237gitlab # [ 0.519855] x86/mm: Memory block size: 128MB238gitlab # [ 0.523715] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.524745] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.525759] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.527006] PM: RTC time: 10:31:32, date: 2026-09-09242gitlab # [ 0.530773] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.533161] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.533745] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.536084] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.536681] audit: initializing netlink subsys (disabled)247gitlab # [ 0.537724] audit: type=2000 audit(1788949892.579:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.537991] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.538666] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.539624] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.540463] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.541438] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.542491] cpuidle: using governor menu254gitlab # [ 0.544890] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.545934] PCI: Using configuration type 1 for base access256gitlab # [ 0.546664] PCI: Using configuration type 1 for extended access257gitlab # [ 0.547795] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.549792] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.550667] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.551664] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.552662] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.555923] ACPI: Added _OSI(Module Device)263gitlab # [ 0.556664] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.557423] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.560704] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.564960] ACPI: Interpreter enabled267gitlab # [ 0.565683] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.566425] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.566706] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.567672] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.568659] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.573659] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.573659] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.577107] acpiphp: Slot [3] registered275gitlab # [ 0.577702] acpiphp: Slot [4] registered276gitlab # [ 0.578436] acpiphp: Slot [5] registered277gitlab # [ 0.578693] acpiphp: Slot [6] registered278gitlab # [ 0.579421] acpiphp: Slot [7] registered279gitlab # [ 0.580702] acpiphp: Slot [8] registered280gitlab # [ 0.581436] acpiphp: Slot [9] registered281gitlab # [ 0.581697] acpiphp: Slot [10] registered282gitlab # [ 0.582458] acpiphp: Slot [11] registered283gitlab # [ 0.583703] acpiphp: Slot [12] registered284gitlab # [ 0.584447] acpiphp: Slot [13] registered285gitlab # [ 0.584685] acpiphp: Slot [14] registered286gitlab # [ 0.585434] acpiphp: Slot [15] registered287gitlab # [ 0.586683] acpiphp: Slot [16] registered288gitlab # [ 0.587425] acpiphp: Slot [17] registered289gitlab # [ 0.587684] acpiphp: Slot [18] registered290gitlab # [ 0.588440] acpiphp: Slot [19] registered291gitlab # [ 0.589687] acpiphp: Slot [20] registered292gitlab # [ 0.590445] acpiphp: Slot [21] registered293gitlab # [ 0.590684] acpiphp: Slot [22] registered294gitlab # [ 0.591445] acpiphp: Slot [23] registered295gitlab # [ 0.592683] acpiphp: Slot [24] registered296gitlab # [ 0.593411] acpiphp: Slot [25] registered297gitlab # [ 0.593683] acpiphp: Slot [26] registered298gitlab # [ 0.594445] acpiphp: Slot [27] registered299gitlab # [ 0.595682] acpiphp: Slot [28] registered300gitlab # [ 0.596405] acpiphp: Slot [29] registered301gitlab # [ 0.596695] acpiphp: Slot [30] registered302gitlab # [ 0.597434] acpiphp: Slot [31] registered303gitlab # [ 0.598677] PCI host bridge to bus 0000:00304gitlab # [ 0.599396] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.600690] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.601663] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.602663] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.603663] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.605664] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.606900] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.608147] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.610109] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.613423] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.614692] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.615663] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.616663] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.617663] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.618863] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.621692] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.623785] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.625938] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.626669] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.628883] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.642900] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.645709] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.647753] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.651519] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.657069] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.667691] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.670689] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.672725] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.699711] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.706248] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.717688] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.719684] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.722723] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.728785] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.738705] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.740684] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.742722] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.749793] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.756681] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.758678] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.760737] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.765420] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.772732] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.773679] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.774699] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.780115] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.790188] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.791686] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.794744] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.799384] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.807687] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.809681] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.810710] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.813682] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.817099] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.819679] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.820664] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.822934] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.826685] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.827550] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.828414] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.830859] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.834734] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.837694] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.839726] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.852188] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.856122] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.859026] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.861054] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.863862] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.870047] iommu: Default domain type: Translated375gitlab # [ 0.871667] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.875814] ACPI: bus type USB registered377gitlab # [ 0.877882] usbcore: registered new interface driver usbfs378gitlab # [ 0.879858] usbcore: registered new interface driver hub379gitlab # [ 0.882755] usbcore: registered new device driver usb380gitlab # [ 0.888050] NetLabel: Initializing381gitlab # [ 0.889671] NetLabel: domain hash size = 128382gitlab # [ 0.891668] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.893763] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.896690] PCI: Using ACPI for IRQ routing385gitlab # [ 0.898839] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.899659] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.899659] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.907680] vgaarb: loaded389gitlab # [ 0.909219] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.911667] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.917669] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.924852] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.926296] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.929131] pnp: PnP ACPI init395gitlab # [ 0.931577] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.944595] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.948464] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.951117] NET: Registered PF_INET protocol family399gitlab # [ 0.956221] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.985944] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.987512] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.988920] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.991560] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.992931] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.994568] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.996233] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.997740] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.999236] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 1.000288] NET: Registered PF_XDP protocol family410gitlab # [ 1.001204] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 1.002274] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 1.003339] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 1.004523] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 1.005715] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 1.007120] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 1.008145] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 1.010690] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 1.013296] PCI: CLS 0 bytes, default 64419gitlab # [ 1.014129] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 1.014710] Trying to unpack rootfs image as initramfs...421gitlab # [ 1.015241] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 1.018120] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns423gitlab # [ 1.039289] Initialise system trusted keyrings424gitlab # [ 1.040582] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.052443] Key type asymmetric registered426gitlab # [ 1.053262] Asymmetric key parser 'x509' registered427gitlab # [ 1.054207] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.055961] io scheduler mq-deadline registered429gitlab # [ 1.056821] io scheduler kyber registered430gitlab # [ 1.063164] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.064569] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.067196] Linux agpgart interface v0.103433gitlab # [ 1.068049] ACPI: bus type drm_connector registered434gitlab # [ 1.071289] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.072457] usbserial: USB Serial support registered for generic436gitlab # [ 1.073505] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.073505] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.075879] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.077398] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.078674] NET: Registered PF_INET6 protocol family441gitlab # [ 1.080628] Segment Routing with IPv6442gitlab # [ 1.081389] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.084045] IPI shorthand broadcast: enabled444gitlab # [ 1.088856] sched_clock: Marking stable (939078235, 149363819)->(1110052572, -21610518)445gitlab # [ 1.090779] registered taskstats version 1446gitlab # [ 1.091848] Loading compiled-in X.509 certificates447gitlab # [ 1.102044] Demotion targets for Node 0: null448gitlab # [ 1.103158] Key type .fscrypt registered449gitlab # [ 1.103894] Key type fscrypt-provisioning registered450gitlab # [ 1.104907] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.105887] ima: Allocated hash algorithm: sha1452gitlab # [ 1.106787] ima: No architecture policies found453gitlab # [ 1.107950] PM: Magic number: 10:232:527454gitlab # [ 1.109781] RAS: Correctable Errors collector initialized.455gitlab # [ 1.114403] clk: Disabling unused clocks456gitlab # [ 1.115209] PM: genpd: Disabling unused power domains457gitlab # [ 1.310215] Freeing initrd memory: 29392K458gitlab # [ 1.314277] Freeing unused decrypted memory: 2028K459gitlab # [ 1.317447] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.318557] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.320838] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.322731] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.387761] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.388943] Run /init as init process465gitlab # [ 1.402909] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.426469] fuse: init (API version 7.45)467gitlab # [ 1.434964] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.442165] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.445519] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.491268] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.828115] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.868701] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.870882] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.873153] systemd[1]: Running in initrd.475gitlab # [ 1.875715] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.878597] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.994770] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 2.038615] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.050000] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.051162] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.052581] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.053672] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.054723] systemd[1]: Reached target Path Units.484gitlab # [ 2.055554] systemd[1]: Reached target Slice Units.485gitlab # [ 2.056407] systemd[1]: Reached target Swaps.486gitlab # [ 2.057191] systemd[1]: Reached target Timer Units.487gitlab # [ 2.058186] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.059404] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.060568] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.061522] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.062488] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.063396] systemd[1]: Reached target Socket Units.493gitlab # [ 2.065424] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.067606] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.069784] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.080936] systemd[1]: Starting Journal Service...497gitlab # [ 2.085357] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.087842] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.093921] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.100210] systemd-journald[92]: Collecting audit messages is disabled.501gitlab # [ 2.117208] systemd[1]: Finished Create List of Static Device Nodes.502gitlab # [ 2.125313] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 2.128945] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.504gitlab # [ 2.132414] systemd[1]: Finished Load Kernel Module configfs.505gitlab # [ 2.134128] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config506gitlab # [ 2.137065] netfs: FS-Cache loaded507gitlab # [ 2.138057] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev508gitlab # [ 2.139508] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...509gitlab # [ 2.145782] systemd[1]: Finished Load Kernel Modules.510gitlab # [ 2.146858] 9pnet: Installing 9P2000 support511gitlab # [ 2.148928] systemd[1]: Starting Apply Kernel Variables...512gitlab # [ 2.153066] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.513gitlab # [ 2.157056] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.514gitlab # [ 2.158811] systemd[1]: Finished Load Kernel Module 9pnet_virtio.515gitlab # [ 2.160829] systemd[1]: Finished Apply Kernel Variables.516gitlab # [ 2.011730] systemd-modules-load[93]: Using 4 probe threads517gitlab # [ 2.162811] systemd[1]: Started Journal Service.518gitlab # [ 2.013720] systemd-modules-load[93]: Inserted module 'virtio_balloon'519gitlab # [ 2.015226] systemd-modules-load[93]: Inserted module 'virtio_gpu'520gitlab # [ 2.016247] systemd-modules-load[93]: Inserted module 'dm_mod'521gitlab # [ 2.021324] systemd[1]: Starting Create Static Device Nodes in /dev...522gitlab # [ 2.033710] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 2.035235] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 2.036265] systemd[1]: Reached target Local File Systems.525gitlab # [ 2.037030] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 2.037989] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.050091] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.060073] systemd-udevd[112]: Using default interface naming scheme 'v261'.529gitlab # [ 2.071515] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.097325] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.098212] systemd[1]: Reached target System Initialization.532gitlab # [ 2.099025] systemd[1]: Reached target Basic System.533gitlab # [ 2.323085] uhci_hcd 0000:00:01.2: UHCI Host Controller534gitlab # [ 2.324347] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1535gitlab # [ 2.325608] uhci_hcd 0000:00:01.2: detected 2 ports536gitlab # [ 2.326448] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140537gitlab # [ 2.327580] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18538gitlab # [ 2.328774] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1539gitlab # [ 2.329873] usb usb1: Product: UHCI Host Controller540gitlab # [ 2.330626] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd541gitlab # [ 2.331415] usb usb1: SerialNumber: 0000:00:01.2542gitlab # [ 2.332410] hub 1-0:1.0: USB hub found543gitlab # [ 2.332912] SCSI subsystem initialized544gitlab # [ 2.333068] hub 1-0:1.0: 2 ports detected545gitlab # [ 2.339233] virtio_blk virtio4: 4/0/0 default/read/poll queues546gitlab # [ 2.355107] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)547gitlab # [ 2.362501] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12548gitlab # [ 2.364899] virtio_blk virtio5: 4/0/0 default/read/poll queues549gitlab # [ 2.366866] serio: i8042 KBD port at 0x60,0x64 irq 1550gitlab # [ 2.367606] serio: i8042 AUX port at 0x60,0x64 irq 12551gitlab # [ 2.371546] virtio_blk virtio5: [vdb] 11843408 512-byte logical blocks (6.06 GB/5.65 GiB)552gitlab # [ 2.393724] scsi host0: ata_piix553gitlab # [ 2.401617] scsi host1: ata_piix554gitlab # [ 2.402261] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0555gitlab # [ 2.403423] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556gitlab # [ 2.264351] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.265974] systemd[1]: Starting Virtual Console Setup...558gitlab # [ 2.271632] (udev-worker)[131]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.559gitlab # [ 2.273917] (udev-worker)[131]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.280427] systemd[1]: Found device /dev/disk/by-label/nixos.561gitlab # [ 2.281868] systemd[1]: Reached target Initrd Root Device.562gitlab # [ 2.282972] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...563gitlab # [ 2.289557] systemd-vconsole-setup[150]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 2.291150] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 2.295058] systemd[1]: Found device /dev/disk/by-label/nix-store.566gitlab # [ 2.305562] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks567gitlab # [ 2.365968] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.568gitlab # [ 2.552407] usb 1-1: new full-speed USB device number 2 using uhci_hcd569gitlab # [ 2.560801] ata2: found unknown device (class 0)570gitlab # [ 2.563473] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100571gitlab # [ 2.567463] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5572gitlab # [ 2.593052] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0573gitlab # [ 2.625353] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.649937] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.719717] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.721001] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.722053] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.722704] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.723272] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.758118] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.770949] usbcore: registered new interface driver usbhid582gitlab # [ 2.773038] usbhid: USB HID core driver583gitlab # [ 2.782124] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.786181] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.955575] systemd[1]: Mounting /sysroot...586gitlab # [ 3.247993] EXT4-fs (vda): mounted filesystem 56b7def1-4b9e-422e-8124-6d5c4449629d r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.101662] systemd[1]: Mounted /sysroot.588gitlab # [ 3.103090] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.105818] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.107762] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.114093] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.115839] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.122379] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.126373] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.278346] erofs (device vdb): mounted with root inode @ nid 128.596gitlab # [ 3.129790] systemd[1]: Mounted /sysroot/nix/.rw-store.597gitlab # [ 3.135137] systemd[1]: Starting rw-sysroot-nix-store.service...598gitlab # [ 3.137495] systemd[1]: Mounted /sysroot/nix/.ro-store.599gitlab # [ 3.139116] systemd[1]: Mounted /sysroot/run.600gitlab # [ 3.290812] 9p: Installing v9fs 9p2000 file system support601gitlab # [ 3.141735] systemd-sysroot-fstab-check[177]: /sysroot should be mounted in the initrd, will request daemon-reload.602gitlab # [ 3.145737] systemd[1]: Reload requested from client PID 177 ('systemd-sysroot') (unit initrd-parse-etc.service)...603gitlab # [ 3.147818] systemd[1]: Reloading...604gitlab # [ 3.206804] systemd[1]: Reloading finished in 60 ms.605gitlab # [ 3.232418] systemd-sysroot-fstab-check[177]: Requesting initrd-fs.target/start/replace...606gitlab # [ 3.236733] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.238414] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.240161] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.242546] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.248928] systemd-sysroot-fstab-check[177]: Requesting swap.target/start/replace...611gitlab # [ 3.252918] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.255018] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.257265] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.258908] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.275878] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.277562] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.956127] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 4.004716] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 4.006767] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 4.008839] systemd[1]: Starting Find NixOS closure...621gitlab # [ 4.010739] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 4.036987] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 4.039816] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 4.052982] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.054901] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.056982] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.092102] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.094311] systemd[1]: Stopped target Basic System.629gitlab # [ 4.096259] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.098291] systemd[1]: Stopped target Path Units.631gitlab # [ 4.100133] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.102751] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.106852] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.108752] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.111413] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.113789] systemd[1]: Stopped target Swaps.637gitlab # [ 4.115508] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.117393] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.119483] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.121601] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.124407] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.126326] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.130120] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.132292] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.134395] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.135908] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.137917] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.139391] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.141557] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.143729] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.145948] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.147728] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.149314] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.151203] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.152403] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.153218] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.154274] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.155343] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.156053] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.157040] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.157954] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.158934] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.159806] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.160745] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.161761] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.162810] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.163581] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.164378] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.165391] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.166269] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.167401] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.168404] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.169342] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.170237] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.171344] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.172130] systemd[1]: Reached target Switch Root.677gitlab # [ 4.172843] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.279169] initrd-nixos-activation-start[226]: booting system configuration /nix/store/f6ljkhhmp1hk802y8g79843ykx77rkxf-nixos-system-gitlab-test679gitlab # [ 4.317859] initrd-nixos-activation-start[226]: running activation script...680gitlab # [ 4.541698] initrd-nixos-activation-start[249]: setting up /etc...681gitlab # [ 4.613271] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.615457] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.616783] systemd[1]: Starting Switch Root...684gitlab # [ 4.632061] systemd[1]: Switching root.685gitlab # [ 4.853133] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.955502] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.319097] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.329116] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.331008] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.332973] systemd[1]: Detected first boot.691gitlab # [ 5.335495] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.581250] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.675890] systemd[1]: Applying preset policy.694gitlab # [ 5.818490] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.926728] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.928139] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.930413] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.932511] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.933888] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.935385] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.936408] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.938044] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.939165] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.939911] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.940764] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.941605] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.942376] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.943211] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.944136] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.945139] systemd[1]: Reached target Path Units.711gitlab # [ 5.945870] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.946722] systemd[1]: Reached target Slice Units.713gitlab # [ 5.947485] systemd[1]: Reached target Swaps.714gitlab # [ 5.948882] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.950895] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.952429] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.954000] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.954931] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.957258] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.958744] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.960608] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.961791] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.962966] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.964292] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.967146] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.968235] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.969192] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.971893] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.974010] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.976009] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.978441] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.983889] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.984899] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.987649] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.988621] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.990147] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.991969] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 6.007380] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 6.009286] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 6.014325] systemd[1]: Starting Journal Service...741gitlab # [ 6.016650] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 6.020427] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 6.028699] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 6.031132] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 6.037562] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 6.043466] EXT4-fs (vda): re-mounted 56b7def1-4b9e-422e-8124-6d5c4449629d.747gitlab # [ 6.050841] systemd[1]: Listening on Journal Log Access Socket.748gitlab # [ 6.052816] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 6.054786] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 6.055688] systemd-journald[319]: Collecting audit messages is enabled.751gitlab # [ 6.057603] systemd[1]: Mounted Kernel Debug File System.752gitlab # [ 6.059612] systemd[1]: Mounted Kernel Trace File System.753gitlab # [ 6.062267] systemd[1]: Finished Create List of Static Device Nodes.754gitlab # [ 6.065736] systemd[1]: modprobe@configfs.service: Deactivated successfully.755gitlab # [ 6.068752] systemd[1]: Finished Load Kernel Module configfs.756gitlab # [ 6.068839] loop: module loaded757gitlab # [ 6.069758] systemd[1]: Mounted FUSE Control File System.758gitlab # [ 6.071799] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.759gitlab # [ 6.073312] systemd[1]: Finished Load Kernel Modules.760gitlab # [ 6.074710] systemd[1]: Finished Remount Root and Kernel File Systems.761gitlab # [ 6.076555] systemd[1]: Listening on Disk Image Download Service Socket.762gitlab # [ 6.078534] systemd[1]: Mounting Kernel Configuration File System...763gitlab # [ 5.930457] systemd[1]: Queued start job for default target Multi-User System.764gitlab # [ 5.931672] systemd[1]: Unnecessary job was removed for /dev/vdb.765gitlab # [ 5.932805] systemd[1]: systemd-journald.service: Deactivated[ 6.082416] systemd[1]: Starting Firewall...766gitlab # successfully.767gitlab # [ 6.083479] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore768gitlab # [ 5.936183] systemd-modules-load[320]: Using 3 probe threads769gitlab # [ 5.937219] systemd-modules-load[320]: Inserted module 'tls'770gitlab # [ 5.938378] systemd-oomd[321]: No swap; memory pressure usage will be degraded771gitlab # [ 5.939830] systemd-modules-load[320]: Inserted module 'loop'772gitlab # [ 6.093723] systemd[1]: Starting Load/Save OS Random Seed...773gitlab # [ 6.095569] systemd[1]: Starting Apply Kernel Variables...774gitlab # [ 6.098443] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...775gitlab # [ 6.099703] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os776gitlab # [ 6.102125] systemd[1]: Started Journal Service.777gitlab # [ 5.958746] systemd[1]: Mounted Kernel Configuration File System.778gitlab # [ 5.966766] systemd[1]: Finished Apply Kernel Variables.779gitlab # [ 5.968695] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.780gitlab # [ 5.972774] systemd[1]: Starting Flush Journal to Persistent Storage...781gitlab # [ 5.976430] systemd[1]: Starting Create Static Device Nodes in /dev...782gitlab # [ 6.138712] systemd-journald[319]: Received client request to flush runtime journal.783gitlab # [ 6.359768] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3784gitlab # [ 6.369208] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0785gitlab # [ 6.371821] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD786gitlab # [ 6.373396] ACPI: button: Power Button [PWRF]787gitlab # [ 6.379624] rtc_cmos 00:05: RTC can wake from S4788gitlab # [ 6.386197] Floppy drive(s): fd0 is 2.88M AMI BIOS789gitlab # [ 6.394591] rtc_cmos 00:05: registered as rtc0790gitlab # [ 6.395319] rtc_cmos 00:05: setting system clock to 2026-09-09T10:31:37 UTC (1788949897)791gitlab # [ 6.399687] FDC 0 is a S82078B792gitlab # [ 6.400723] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs793gitlab # [ 6.415227] parport_pc 00:03: reported by Plug and Play ACPI794gitlab # [ 6.416217] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]795gitlab # [ 6.418751] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5796gitlab # [ 6.433406] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console797gitlab # [ 6.443632] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4798gitlab # [ 6.451469] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6799gitlab # [ 6.455608] Console: switching to colour dummy device 80x25800gitlab # [ 6.458062] [drm] Found bochs VGA, ID 0xb0c5.801gitlab # [ 6.458064] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.802gitlab # [ 6.461553] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic803gitlab # [ 6.462422] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0804gitlab # [ 6.472783] Console: switching to colour frame buffer device 160x50805gitlab # [ 6.474172] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device806gitlab # [ 6.504377] mousedev: PS/2 mouse device common for all mice807gitlab # [ 6.558039] ppdev: user-space parallel port driver808gitlab # [ 6.587194] kvm_amd: TSC scaling supported809gitlab # [ 6.587897] kvm_amd: Nested Virtualization enabled810gitlab # [ 6.588578] kvm_amd: Nested Paging enabled811gitlab # [ 6.589054] kvm_amd: LBR virtualization supported812gitlab # [ 6.589741] kvm_amd: Virtual VMLOAD VMSAVE supported813gitlab # [ 6.590497] kvm_amd: Virtual GIF supported814gitlab # [ 6.591080] kvm_amd: Virtual NMI enabled815gitlab # [ 6.625879] EDAC MC: Ver: 3.0.0816gitlab # [ 6.508599] systemd[1]: Finished Create Static Device Nodes in /dev.817gitlab # [ 6.509995] systemd[1]: Reached target Preparation for Local File Systems.818gitlab # [ 6.511477] systemd[1]: Starting Rule-based Manager for Device Events and Files...819gitlab # [ 6.513271] systemd-udevd[354]: Using default interface naming scheme 'v261'.820gitlab # [ 6.514542] systemd[1]: Finished Coldplug All udev Devices.821gitlab # [ 6.515885] systemd[1]: Started Rule-based Manager for Device Events and Files.822gitlab # [ 6.517022] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse823gitlab # [ 6.518686] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.824gitlab # [ 6.520057] (udev-worker)[427]: Network interface NamePolicy= disabled on kernel command line.825gitlab # [ 6.521429] (udev-worker)[416]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.826gitlab # [ 6.523692] (udev-worker)[416]: Network interface NamePolicy= disabled on kernel command line.827gitlab # [ 6.525101] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.828gitlab # [ 6.526080] systemd[1]: Condition check resulted in Virtio network device being skipped.829gitlab # [ 6.527171] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore830gitlab # [ 6.528850] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67831gitlab # [ 6.530927] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore832gitlab # [ 6.532451] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os833gitlab # [ 6.533699] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os834gitlab # [ 6.535042] systemd[1]: Finished Load/Save OS Random Seed.835gitlab # [ 6.535885] systemd[1]: Reached target First Boot Complete.836gitlab # [ 6.536955] systemd[1]: Finished Firewall.837gitlab # [ 6.537638] systemd[1]: Starting Virtual Console Setup...838gitlab # [ 6.538440] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.839gitlab # [ 6.539694] systemd[1]: Stopped Virtual Console Setup.840gitlab # [ 6.540459] systemd[1]: Starting Virtual Console Setup...841gitlab # [ 6.541238] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.842gitlab # [ 6.542277] systemd[1]: Stopped Virtual Console Setup.843gitlab # [ 6.543042] systemd[1]: Starting Virtual Console Setup...844gitlab # [ 6.543823] systemd[1]: Finished Flush Journal to Persistent Storage.845gitlab # [ 6.544806] systemd-vconsole-setup[491]: Configuration of first virtual console was skipped, ignoring remaining ones.846gitlab # [ 6.546293] systemd[1]: Finished Virtual Console Setup.847gitlab # [ 6.780995] systemd[1]: Mounting /run/wrappers...848gitlab # [ 6.808710] systemd[1]: Mounted /run/wrappers.849gitlab # [ 6.810119] systemd[1]: Reached target Local File Systems.850gitlab # [ 6.811770] systemd[1]: Listening on Boot Loader Control Service Socket.851gitlab # [ 6.814367] systemd[1]: Starting register-nix-paths.service...852gitlab # [ 6.816589] systemd[1]: Starting Create SUID/SGID Wrappers...853gitlab # [ 6.817586] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.854gitlab # [ 6.819104] systemd[1]: Starting Save Transient machine-id to Disk...855gitlab # [ 6.829293] systemd[1]: Starting Create System Files and Directories...856gitlab # [ 6.863644] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.857gitlab # [ 6.864858] systemd[1]: Finished Save Transient machine-id to Disk.858gitlab # [ 6.873790] systemd[1]: Finished Create System Files and Directories.859gitlab # [ 6.879641] systemd[1]: Starting Rebuild Journal Catalog...860gitlab # [ 6.889145] systemd[1]: Starting Record System Boot/Shutdown in UTMP...861gitlab # [ 6.905224] systemd[1]: Finished Record System Boot/Shutdown in UTMP.862gitlab # [ 6.910968] systemd[1]: Finished Rebuild Journal Catalog.863gitlab # [ 6.912148] systemd[1]: Starting Update is Completed...864gitlab # [ 6.935984] systemd[1]: Finished Update is Completed.865gitlab # [ 6.939320] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.866gitlab # [ 6.940305] systemd[1]: Finished Create SUID/SGID Wrappers.867gitlab # [ 7.588816] systemd[1]: Finished register-nix-paths.service.868gitlab # [ 7.590769] systemd[1]: Reached target System Initialization.869gitlab # [ 7.592297] systemd[1]: Started Discard unused filesystem blocks once a week.870gitlab # [ 7.594208] systemd[1]: Started logrotate.timer.871gitlab # [ 7.595469] systemd[1]: Started Daily Cleanup of Temporary Directories.872gitlab # [ 7.597211] systemd[1]: Reached target Timer Units.873gitlab # [ 7.598531] systemd[1]: Listening on D-Bus System Message Bus Socket.874gitlab # [ 7.600253] systemd[1]: Listening on Nix Daemon Socket.875gitlab # [ 7.606490] systemd[1]: Starting nixbot CI service socket...876gitlab # [ 7.608024] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.877gitlab # [ 7.610303] systemd[1]: Starting D-Bus System Message Bus...878gitlab # [ 7.611838] systemd[1]: Listening on nixbot CI service socket.879gitlab # [ 7.613411] systemd[1]: Reached target Socket Units.880gitlab # [ 7.660578] dbus-broker-launch[575]: Looking up NSS user entry for 'systemd-timesync'...881gitlab # [ 7.663517] dbus-broker-launch[575]: NSS returned no entry for 'systemd-timesync'882gitlab # [ 7.665279] dbus-broker-launch[575]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"883gitlab # [ 7.668246] systemd[1]: Started D-Bus System Message Bus.884gitlab # [ 7.685100] dbus-broker-launch[575]: Ready885gitlab # [ 7.687126] systemd[1]: Reached target Basic System.886gitlab # [ 7.689303] systemd[1]: Started backdoor.service.887gitlab # [ 7.691453] systemd[1]: Starting gitlab-config.service...888gitlab # [ 7.694502] systemd[1]: Starting Import lastlog data into lastlog2 database...889gitlab # [ 7.708215] systemd[1]: Starting Logrotate configuration check...890gitlab # [ 7.710357] systemd[1]: Starting Name Service Cache Daemon (nsncd)...891gitlab # [ 7.719265] systemd[1]: Starting Post-Boot Actions...892gitlab # [ 7.726685] systemd[1]: Started Reset console on configuration changes.893gitlab # [ 7.729341] logrotate[580]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.894gitlab # [ 7.732054] logrotate[580]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf895gitlab # [ 7.734344] logrotate[580]: note: 'monthly' overrides previously specified 'weekly'896gitlab # [ 7.736228] logrotate[580]: Reading state from file: /var/lib/logrotate.status897gitlab # [ 7.738288] logrotate[580]: state file /var/lib/logrotate.status does not exist898gitlab # [ 7.740213] logrotate[580]: Allocating hash table for state file, size 64 entries899gitlab # [ 7.741542] logrotate[580]: Handling 4 logs900gitlab # [ 7.742788] logrotate[580]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed901gitlab # [ 7.745451] logrotate[580]: considering log /var/log/btmp902gitlab # [ 7.747451] logrotate[580]: Creating new state903gitlab # connecting to host...904gitlab # [ 7.748691] logrotate[580]: Now: 2026-09-09 10:31905gitlab # [ 7.749446] logrotate[580]: Last rotated at 2026-09-09 10:00906gitlab # [ 7.750389] logrotate[580]: log does not need rotating (log has already been rotated)907gitlab # [ 7.751421] logrotate[580]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed908gitlab # [ 7.753494] logrotate[580]: considering log /var/log/wtmp909gitlab # [ 7.754470] logrotate[580]: Creating new state910gitlab # [ 7.755191] logrotate[580]: Now: 2026-09-09 10:31911gitlab # [ 7.755920] logrotate[580]: Last rotated at 2026-09-09 10:00912gitlab # [ 7.756650] logrotate[580]: log does not need rotating (log has already been rotated)913gitlab # [ 7.757561] logrotate[580]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed914gitlab # [ 7.758113] logrotate[580]: switching euid from 0 to 165 and egid from 0 to 165 (pid 580)915gitlab # [ 7.758665] logrotate[580]: considering log /var/gitlab/state/log/*.log916gitlab # [ 7.759454] logrotate[580]: log /var/gitlab/state/log/*.log does not exist -- skipping917gitlab # [ 7.760078] logrotate[580]: Creating new state918gitlab # [ 7.760806] logrotate[580]: switching euid from 165 to 0 and egid from 165 to 0 (pid 580)919gitlab # [ 7.761575] logrotate[580]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed920gitlab # [ 7.762031] logrotate[580]: switching euid from 0 to 60 and egid from 0 to 60 (pid 580)921gitlab # [ 7.762451] logrotate[580]: considering log /var/log/nginx/*.log922gitlab # [ 7.762901] logrotate[580]: log /var/log/nginx/*.log does not exist -- skipping923gitlab # [ 7.763497] logrotate[580]: Creating new state924gitlab # [ 7.763927] logrotate[580]: not running postrotate script, since no logs were rotated925gitlab # [ 7.764543] logrotate[580]: switching euid from 60 to 0 and egid from 60 to 0 (pid 580)926gitlab # [ 7.765305] nsncd[581]: Sep 09 10:31:38.995 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"927gitlab # [ 7.765871] systemd[1]: Starting resolvconf update...928gitlab # [ 7.766622] systemd[1]: Started Name Service Cache Daemon (nsncd).929gitlab # [ 7.767233] systemd[1]: Finished Logrotate configuration check.930gitlab # [ 7.767750] systemd[1]: Finished Post-Boot Actions.931gitlab # [ 7.768878] systemd[1]: Reached target Host and Network Name Lookups.932gitlab # [ 7.769543] systemd[1]: Reached target User and Group Name Lookups.933gitlab # [ 7.769983] systemd[1]: Starting User Login Management...934gitlab # [ 7.770579] systemd[1]: Finished Import lastlog data into lastlog2 database.935gitlab: Guest shell says: b'Spawning backdoor root shell...\n'936gitlab # [ 7.790865] systemd[1]: Stopped target Host and Network Name Lookups.937gitlab # [ 7.791540] systemd[1]: Stopping Host and Network Name Lookups...938gitlab # [ 7.791944] systemd[1]: Stopped target User and Group Name Lookups.939gitlab: connected to guest root shell940gitlab # [ 7.792570] systemd[1]: Stopping User and Group Name Lookups...941gitlab: (connecting took 8.49 seconds)942gitlab # [ 7.793413] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...943gitlab: (finished: waiting for the VM to finish booting, in 8.50 seconds)944gitlab # [ 7.795527] systemd[1]: nscd.service: Deactivated successfully.945gitlab # [ 7.796429] systemd[1]: Stopped Name Service Cache Daemon (nsncd).946gitlab # [ 7.797675] systemd[1]: nscd.service: Consumed 20ms CPU time over 85ms wall clock time, 7.4M memory peak, 5.5M read from disk.947gitlab # [ 7.800089] systemd[1]: Starting Name Service Cache Daemon (nsncd)...948gitlab # [ 7.806971] systemd-logind[609]: New seat seat0.949gitlab # [ 7.811925] systemd-logind[609]: Watching system buttons on /dev/input/event2 (Power Button)950gitlab # [ 7.813075] systemd-logind[609]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)951gitlab # [ 7.814236] systemd-logind[609]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)952gitlab # [ 7.815465] systemd[1]: Started User Login Management.953gitlab # [ 7.816226] systemd[1]: Starting linger-users.service...954gitlab # [ 7.819521] nsncd[663]: Sep 09 10:31:39.073 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"955gitlab # [ 7.821419] systemd[1]: Finished resolvconf update.956gitlab # [ 7.822353] systemd[1]: Started Name Service Cache Daemon (nsncd).957gitlab # [ 7.823236] systemd[1]: Reached target Preparation for Network.958gitlab # [ 7.824052] systemd[1]: Reached target Host and Network Name Lookups.959gitlab # [ 7.824859] systemd[1]: Reached target User and Group Name Lookups.960gitlab # [ 7.826746] systemd[1]: Starting DHCP Client...961gitlab # [ 7.829021] systemd[1]: Starting Address configuration of eth1...962gitlab # [ 7.829903] systemd[1]: Starting Extra networking commands....963gitlab # [ 7.832117] systemd[1]: linger-users.service: Deactivated successfully.964gitlab # [ 7.832991] systemd[1]: Finished linger-users.service.965gitlab # [ 7.858452] network-addresses-eth1-start[692]: adding address 192.168.1.1/24... done966gitlab # [ 7.861910] network-addresses-eth1-start[692]: adding address 2001:db8:1::1/64... done967gitlab # [ 7.866801] systemd[1]: Finished Address configuration of eth1.968gitlab # [ 7.887861] systemd[1]: Finished Extra networking commands..969gitlab # [ 7.889431] systemd[1]: Reached target Network.970gitlab # [ 7.890602] systemd[1]: Starting gitlab-workhorse.service...971gitlab # [ 7.893298] systemd[1]: Starting Nginx Web Server...972gitlab # [ 7.894803] systemd[1]: Starting PostgreSQL Server...973gitlab # [ 7.897450] systemd[1]: Starting Redis Server - redis-gitlab...974gitlab # [ 7.901067] systemd[1]: Starting Permit User Sessions...975gitlab # [ 7.903850] dhcpcd[714]: dhcpcd-10.3.2 starting976gitlab # [ 7.906914] dhcpcd[768]: dev: loaded udev977gitlab # [ 8.060913] 8021q: 802.1Q VLAN Support v1.8978gitlab # [ 8.061556] 8021q: adding VLAN 0 to HW filter on device eth1979gitlab # [ 7.912583] systemd[1]: Finished Permit User Sessions.980gitlab # [ 7.917138] systemd[1]: Started Getty on tty1.981gitlab # [ 7.917752] systemd[1]: Reached target Login Prompts.982gitlab # [ 7.923574] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.983gitlab # [ 8.144061] cfg80211: Loading compiled-in X.509 certificates for regulatory database984gitlab # [ 8.150708] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'985gitlab # [ 8.152189] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'986gitlab # [ 8.153915] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2987gitlab # [ 8.155059] cfg80211: failed to load regulatory.db988gitlab # [ 8.025301] nginx-pre-start[788]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok989gitlab # [ 8.025994] nginx-pre-start[788]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful990gitlab # [ 8.029403] redis-server[787]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.991gitlab # [ 8.029993] redis-server[787]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo992gitlab # [ 8.030557] redis-server[787]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=787, just started993gitlab # [ 8.030965] redis-server[787]: Configuration loaded994gitlab # [ 8.031541] redis[787]: monotonic clock: POSIX clock_gettime995gitlab # [ 8.035071] redis[787]: Running mode=standalone, port=0.996gitlab # [ 8.036093] systemd[1]: Started Redis Server - redis-gitlab.997gitlab # [ 8.036932] redis[787]: Server initialized998gitlab # [ 8.037643] redis[787]: Ready to accept connections unix[ 8.187885] 8021q: adding VLAN 0 to HW filter on device eth0999gitlab # 1000gitlab # [ 8.040183] redis[787]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1001gitlab # [ 8.041984] systemd[1]: Started Nginx Web Server.1002gitlab # [ 8.042876] dhcpcd[768]: eth0: waiting for carrier1003gitlab # [ 8.043791] dhcpcd[768]: eth0: carrier acquired1004gitlab # [ 8.045284] dhcpcd[768]: DUID 00:01:00:01:32:33:f2:0b:52:54:00:12:34:561005gitlab # [ 8.046294] dhcpcd[768]: eth0: IAID 00:12:34:561006gitlab # [ 8.047173] dhcpcd[768]: eth0: adding address fe80::5054:ff:fe12:34561007gitlab # [ 8.056757] postgresql-pre-start[792]: The files belonging to this database system will be owned by user "postgres".1008gitlab # [ 8.059259] postgresql-pre-start[792]: This user must also own the server process.1009gitlab # [ 8.061250] postgresql-pre-start[792]: The database cluster will be initialized with locale "en_US.UTF-8".1010gitlab # [ 8.062447] postgresql-pre-start[792]: The default database encoding has accordingly been set to "UTF8".1011gitlab # [ 8.063732] postgresql-pre-start[792]: The default text search configuration will be set to "english".1012gitlab # [ 8.064373] postgresql-pre-start[792]: Data page checksums are enabled.1013gitlab # [ 8.064895] postgresql-pre-start[792]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1014gitlab # [ 8.065444] postgresql-pre-start[792]: creating subdirectories ... ok1015gitlab # [ 8.065752] postgresql-pre-start[792]: selecting dynamic shared memory implementation ... posix1016gitlab # [ 8.093143] postgresql-pre-start[792]: selecting default "max_connections" ... 1001017gitlab # [ 8.133677] postgresql-pre-start[792]: selecting default "shared_buffers" ... 128MB1018gitlab # [ 8.282145] dhcpcd[768]: eth0: soliciting a DHCP lease1019gitlab # [ 8.440990] NET: Registered PF_PACKET protocol family1020gitlab # [ 8.302920] dhcpcd[768]: eth0: offered 10.0.2.15 from 10.0.2.21021gitlab # [ 8.313368] dhcpcd[768]: eth0: probing address 10.0.2.15/241022gitlab # [ 8.324820] systemd[1]: Started gitlab-workhorse.service.1023gitlab # [ 8.481390] gitlab-workhorse[823]: time="2026-09-09T10:31:39Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41024gitlab # [ 8.482138] gitlab-workhorse[823]: time="2026-09-09T10:31:39Z" level=info msg="Using redis/go-redis"1025gitlab # [ 8.482772] gitlab-workhorse[823]: time="2026-09-09T10:31:39Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1026gitlab # [ 8.510594] postgresql-pre-start[792]: selecting default time zone ... UTC1027gitlab # [ 8.511803] postgresql-pre-start[792]: creating configuration files ... ok1028gitlab # [ 8.674493] postgresql-pre-start[792]: running bootstrap script ... ok1029gitlab # [ 9.120391] postgresql-pre-start[792]: performing post-bootstrap initialization ... ok1030gitlab # [ 9.301514] dhcpcd[768]: eth0: soliciting an IPv6 router1031gitlab # [ 9.303145] dhcpcd[768]: eth0: Router Advertisement from fe80::21032gitlab # [ 9.304630] dhcpcd[768]: eth0: adding address fec0::5054:ff:fe12:3456/641033gitlab # [ 9.307305] dhcpcd[768]: eth0: adding route to fec0::/641034gitlab # [ 9.309150] dhcpcd[768]: eth0: adding default route via fe80::21035gitlab # [ 9.647931] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[849]: mkdir -p /var/gitlab/state/home/.ssh: OK1036gitlab # [ 9.653280] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[849]: chmod 700 /var/gitlab/state/home/.ssh: OK1037gitlab # [ 9.717969] systemd[1]: Finished gitlab-config.service.1038gitlab # [ 9.721534] systemd[1]: Started gitaly.service.1039gitlab # [ 9.931727] postgresql-pre-start[792]: syncing data to disk ... ok1040gitlab # [ 9.933955] postgresql-pre-start[792]: initdb: warning: enabling "trust" authentication for local connections1041gitlab # [ 9.937209] postgresql-pre-start[792]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1042gitlab # [ 9.942100] postgresql-pre-start[792]: Success. You can now start the database server using:1043gitlab # [ 9.945679] postgresql-pre-start[792]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1044gitlab # [ 10.189604] postgres[877]: [877] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1045gitlab # [ 10.191713] postgres[877]: [877] LOG: listening on IPv6 address "::1", port 54321046gitlab # [ 10.192904] postgres[877]: [877] LOG: listening on IPv4 address "127.0.0.1", port 54321047gitlab # [ 10.231377] gitaly[863]: time="2026-09-09T10:31:41.484Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8631048gitlab # [ 10.232102] gitaly[863]: time="2026-09-09T10:31:41.485Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8631049gitlab # [ 10.232742] gitaly[863]: time="2026-09-09T10:31:41.485Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8631050gitlab # [ 10.233187] gitaly[863]: time="2026-09-09T10:31:41.485Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8631051gitlab # [ 10.233470] gitaly[863]: time="2026-09-09T10:31:41.485Z" level=info msg="Starting Gitaly" pid=863 version=1052gitlab # [ 10.254956] postgres[877]: [877] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1053gitlab # [ 10.320383] postgres[893]: [893] LOG: database system was shut down at 2026-09-09 10:31:40 GMT1054gitlab # [ 10.341216] postgres[877]: [877] LOG: database system is ready to accept connections1055gitlab # [ 10.345525] systemd[1]: Started PostgreSQL Server.1056gitlab # [ 10.354450] systemd[1]: Starting PostgreSQL Setup Scripts...1057gitlab # [ 10.411449] gitaly[863]: time="2026-09-09T10:31:41.665Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=170 pid=8631058gitlab # [ 10.412023] gitaly[863]: time="2026-09-09T10:31:41.665Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8631059gitlab # [ 10.413048] gitaly[863]: time="2026-09-09T10:31:41.666Z" level=info msg="finished initializing command factory" duration_ms=1 pid=8631060gitlab # [ 10.413510] gitaly[863]: time="2026-09-09T10:31:41.666Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-863/git-exec-3989965816.d/git pid=8631061gitlab # [ 10.417425] gitaly[863]: time="2026-09-09T10:31:41.671Z" level=info msg="finished detecting git version" duration_ms=4 pid=8631062gitlab # [ 10.418043] gitaly[863]: time="2026-09-09T10:31:41.671Z" level=info msg="using Git version" pid=863 version=2.53.g1063gitlab # [ 10.420241] gitaly[863]: time="2026-09-09T10:31:41.674Z" level=info msg="clearing disk cache object folder" pid=863 storage=default1064gitlab # [ 10.422607] gitaly[863]: time="2026-09-09T10:31:41.676Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2610624485 pid=863 storage=default1065gitlab # [ 10.423305] gitaly[863]: time="2026-09-09T10:31:41.677Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2610624485 pid=863 storage=default1066gitlab # [ 10.423821] gitaly[863]: time="2026-09-09T10:31:41.677Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8631067gitlab # [ 10.424715] gitaly[863]: time="2026-09-09T10:31:41.678Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2610624485 clear_duration_ms=0 pid=863 storage=default1068gitlab # [ 10.425242] gitaly[863]: time="2026-09-09T10:31:41.678Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8631069gitlab # [ 10.469039] gitaly[863]: time="2026-09-09T10:31:41.722Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8631070gitlab # [ 10.469583] gitaly[863]: time="2026-09-09T10:31:41.723Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=863 schema=unix1071gitlab # [ 10.469964] gitaly[863]: time="2026-09-09T10:31:41.723Z" level=info msg="listening at address" address=/run/gitaly/gitaly-863/sock.d/intern pid=863 schema=unix1072gitlab # [ 10.470591] gitaly[863]: time="2026-09-09T10:31:41.722Z" level=info msg="counting repositories" pid=8631073gitlab # [ 10.471419] gitaly[863]: time="2026-09-09T10:31:41.723Z" level=info msg="starting to count repositories" pid=863 storage_path=/var/gitlab/state/repositories1074gitlab # [ 10.472363] gitaly[863]: time="2026-09-09T10:31:41.723Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=863 storage_path=/var/gitlab/state/repositories1075gitlab # [ 10.473530] gitaly[863]: time="2026-09-09T10:31:41.723Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8631076gitlab # [ 10.474505] gitaly[863]: time="2026-09-09T10:31:41.724Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8631077gitlab # [ 10.475609] gitaly[863]: time="2026-09-09T10:31:41.724Z" level=info msg="Started Gitaly" duration_ms=239 pid=8631078gitlab # [ 10.476745] gitaly[863]: time="2026-09-09T10:31:41.724Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8631079gitlab # [ 10.477689] gitaly[863]: time="2026-09-09T10:31:41.725Z" level=info msg="maintenance: daily scheduled" pid=863 scheduled="2026-09-09 12:00:00 +0000 UTC"1080gitlab # [ 10.478797] gitaly[863]: time="2026-09-09T10:31:41.725Z" level=info msg="finished tempdir cleaner walk" pid=863 storage=default time_ms=21081gitlab # [ 10.544570] postgresql-setup-start[906]: CREATE DATABASE1082gitlab # [ 10.599341] postgresql-setup-start[913]: CREATE ROLE1083gitlab # [ 10.651365] postgresql-setup-start[915]: ALTER DATABASE1084gitlab # [ 10.712181] postgresql-setup-start[920]: CREATE ROLE1085gitlab # [ 10.716911] systemd[1]: Finished PostgreSQL Setup Scripts.1086gitlab # [ 10.719786] systemd[1]: Reached target PostgreSQL.1087gitlab # [ 10.725824] systemd[1]: Starting gitlab-db-config.service...1088gitlab # [ 10.728285] systemd[1]: Starting gitlab-postgresql.service...1089gitlab # [ 11.220165] gitlab-postgresql-start[936]: CREATE DATABASE1090gitlab # [ 11.285293] gitlab-postgresql-start[951]: CREATE EXTENSION1091gitlab # [ 11.638967] gitlab-postgresql-start[953]: CREATE EXTENSION1092gitlab # [ 11.644403] systemd[1]: Finished gitlab-postgresql.service.1093gitlab # [ 11.921487] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[930]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1094gitlab # [ 11.922746] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[930]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1095gitlab # [ 11.945562] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[930]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1096gitlab # [ 12.480533] gitaly[863]: time="2026-09-09T10:31:43.733Z" level=info msg="License database preloaded" duration_ms=2248 pid=8631097gitlab # [ 12.673600] dhcpcd[768]: eth0: leased 10.0.2.15 for 86400 seconds1098gitlab # [ 12.674278] dhcpcd[768]: eth0: adding route to 10.0.2.0/241099gitlab # [ 12.674852] dhcpcd[768]: eth0: adding default route via 10.0.2.21100gitlab # [ 12.736590] systemd[1]: Started DHCP Client.1101gitlab # [ 12.737240] systemd[1]: Reached target Network is Online.1102gitlab # [ 42.080244] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[930]: W, [2026-09-09T10:32:13.333696 #930] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1103gitlab # [ 44.380139] postgres[1317]: [1317] ERROR: relation "feature_gates" does not exist at character 5231104gitlab # [ 44.381265] postgres[1317]: [1317] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1105gitlab # [ 44.382786] postgres[1317]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1106gitlab # [ 44.384271] postgres[1317]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1107gitlab # [ 44.385917] postgres[1317]: attidentity AS identity,1108gitlab # [ 44.387441] postgres[1317]: attgenerated as attgenerated1109gitlab # [ 44.388760] postgres[1317]: FROM pg_attribute a1110gitlab # [ 44.390085] postgres[1317]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1111gitlab # [ 44.391547] postgres[1317]: LEFT JOIN pg_type t ON a.atttypid = t.oid1112gitlab # [ 44.393072] postgres[1317]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1113gitlab # [ 44.394557] postgres[1317]: WHERE a.attrelid = '"feature_gates"'::regclass1114gitlab # [ 44.395609] postgres[1317]: AND a.attnum > 0 AND NOT a.attisdropped1115gitlab # [ 44.397201] postgres[1317]: ORDER BY a.attnum1116gitlab # [ 44.398457] postgres[1317]:1117gitlab # [ 47.846513] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1359]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1118gitlab # [ 47.847861] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1359]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1119gitlab # [ 48.538290] gitlab-workhorse[823]: time="2026-09-09T10:32:19Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1120gitlab # [ 58.540827] gitlab-workhorse[823]: time="2026-09-09T10:32:29Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 62.645194] postgres[1425]: [1425] ERROR: relation "table_without_models" does not exist1122gitlab # [ 62.646556] postgres[1425]: [1425] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1123gitlab # [ 68.551318] gitlab-workhorse[823]: time="2026-09-09T10:32:39Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1124gitlab # [ 74.343248] systemd[1]: Finished gitlab-db-config.service.1125gitlab # [ 74.346961] systemd[1]: Started gitlab-sidekiq.service.1126gitlab # [ 74.350376] systemd[1]: Starting gitlab.service...1127gitlab # [ 74.746455] bundle[1592]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1128gitlab # [ 74.747812] bundle[1592]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1129gitlab # [ 74.748750] bundle[1592]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1130gitlab # [ 77.414835] sidekiq-cluster[1591]: {"severity":"INFO","time":"2026-09-09T10:32:48.651Z","message":"Starting cluster with 1 processes"}1131gitlab # [ 77.959173] bundle[1592]: {"timestamp":"2026-09-09T10:32:49.186Z","pid":1592,"message":"* Enabling systemd notification integration"}1132gitlab # [ 77.961123] bundle[1592]: {"timestamp":"2026-09-09T10:32:49.212Z","pid":1592,"message":"Puma starting in cluster mode..."}1133gitlab # [ 77.962180] bundle[1592]: {"timestamp":"2026-09-09T10:32:49.212Z","pid":1592,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1134gitlab # [ 77.963349] bundle[1592]: {"timestamp":"2026-09-09T10:32:49.212Z","pid":1592,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1135gitlab # [ 77.964572] bundle[1592]: {"timestamp":"2026-09-09T10:32:49.212Z","pid":1592,"message":"* Min threads: 0"}1136gitlab # [ 77.965952] bundle[1592]: {"timestamp":"2026-09-09T10:32:49.212Z","pid":1592,"message":"* Max threads: 4"}1137gitlab # [ 77.967538] bundle[1592]: {"timestamp":"2026-09-09T10:32:49.212Z","pid":1592,"message":"* Environment: production"}1138gitlab # [ 77.969048] bundle[1592]: {"timestamp":"2026-09-09T10:32:49.212Z","pid":1592,"message":"* Master PID: 1592"}1139gitlab # [ 77.970205] bundle[1592]: {"timestamp":"2026-09-09T10:32:49.212Z","pid":1592,"message":"* Workers: 2"}1140gitlab # [ 77.971318] bundle[1592]: {"timestamp":"2026-09-09T10:32:49.212Z","pid":1592,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1141gitlab # [ 77.972460] bundle[1592]: {"timestamp":"2026-09-09T10:32:49.212Z","pid":1592,"message":"* Preloading application"}1142gitlab # [ 78.561374] gitlab-workhorse[823]: time="2026-09-09T10:32:49Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 88.561624] gitlab-workhorse[823]: time="2026-09-09T10:32:59Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 98.571354] gitlab-workhorse[823]: time="2026-09-09T10:33:09Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 103.474358] bundle[1592]: W, [2026-09-09T10:33:14.727786 #1592] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 107.189658] sidekiq-cluster[1622]: 2026-09-09T10:33:18.442Z pid=1622 tid=wla INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1622, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432480256}1147gitlab # [ 107.410419] sidekiq-cluster[1622]: W, [2026-09-09T10:33:18.664052 #1622] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1148gitlab # [ 107.455893] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:18.709Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1149gitlab # [ 108.581066] gitlab-workhorse[823]: time="2026-09-09T10:33:19Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1150gitlab # [ 109.745094] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:20.998Z","message":"GitLab reliable fetch activated!"}1151gitlab # [ 109.746340] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:20.998Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1152gitlab # [ 109.774137] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.027Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1153gitlab # [ 109.778448] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.032Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1154gitlab # [ 109.782679] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.036Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 109.788767] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.042Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 109.795335] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.049Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 109.801766] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.055Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 109.807635] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.061Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 109.812805] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.066Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 109.816523] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.070Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 109.820857] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.074Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1162gitlab # [ 109.824939] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.078Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1163gitlab # [ 109.829745] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.083Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1164gitlab # [ 109.833605] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.087Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1165gitlab # [ 109.837970] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.091Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1166gitlab # [ 109.841867] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.095Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1167gitlab # [ 109.846153] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.100Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1168gitlab # [ 109.850748] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.104Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1169gitlab # [ 109.855369] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.109Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1170gitlab # [ 109.859800] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.113Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1171gitlab # [ 109.863890] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.117Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1172gitlab # [ 109.868591] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.122Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1173gitlab # [ 109.874117] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.127Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1174gitlab # [ 109.878863] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.132Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1175gitlab # [ 109.883359] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.137Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1176gitlab # [ 109.887899] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.141Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1177gitlab # [ 109.893240] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.147Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1178gitlab # [ 109.898595] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.152Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1179gitlab # [ 109.903920] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.157Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1180gitlab # [ 109.909276] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.163Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1181gitlab # [ 109.914584] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.168Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1182gitlab # [ 109.918784] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.172Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1183gitlab # [ 109.922911] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.176Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1184gitlab # [ 109.926563] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.180Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1185gitlab # [ 109.930442] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.184Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1186gitlab # [ 109.933966] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.187Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1187gitlab # [ 109.937485] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.191Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1188gitlab # [ 109.941159] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.195Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1189gitlab # [ 109.945377] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.199Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1190gitlab # [ 109.949054] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.202Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1191gitlab # [ 109.952767] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.206Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1192gitlab # [ 109.956877] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.210Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1193gitlab # [ 109.960451] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.214Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1194gitlab # [ 109.964059] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.217Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1195gitlab # [ 109.968293] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.222Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1196gitlab # [ 109.973170] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.227Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1197gitlab # [ 109.977340] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.231Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1198gitlab # [ 109.981119] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.235Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1199gitlab # [ 109.985585] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.239Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1200gitlab # [ 109.989786] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.243Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1201gitlab # [ 109.993827] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.247Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1202gitlab # [ 109.998541] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.252Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1203gitlab # [ 110.003791] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.257Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1204gitlab # [ 110.015755] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.269Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1205gitlab # [ 110.021524] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.275Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1206gitlab # [ 110.025789] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.279Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1207gitlab # [ 110.032537] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.286Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1208gitlab # [ 110.036936] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.290Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1209gitlab # [ 110.041488] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.295Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1210gitlab # [ 110.047307] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.300Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1211gitlab # [ 110.052483] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.306Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1212gitlab # [ 110.055943] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.309Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1213gitlab # [ 110.060169] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.314Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1214gitlab # [ 110.063985] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.317Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1215gitlab # [ 110.066644] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.320Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1216gitlab # [ 110.071383] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.325Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1217gitlab # [ 110.075870] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.329Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1218gitlab # [ 110.079222] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.333Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1219gitlab # [ 110.082785] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.336Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1220gitlab # [ 110.087430] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.341Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1221gitlab # [ 110.091203] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.345Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1222gitlab # [ 110.095182] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.349Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1223gitlab # [ 110.098819] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.352Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1224gitlab # [ 110.159674] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.413Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1225gitlab # [ 110.163576] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.417Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1226gitlab # [ 110.167352] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.421Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1227gitlab # [ 110.171379] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.425Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1228gitlab # [ 110.176487] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.430Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1229gitlab # [ 110.181586] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.435Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1230gitlab # [ 110.186821] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.440Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1231gitlab # [ 110.190244] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.444Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1232gitlab # [ 110.194415] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.448Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1233gitlab # [ 110.199036] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.452Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1234gitlab # [ 110.203980] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.457Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1235gitlab # [ 110.207482] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.461Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1236gitlab # [ 110.213313] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.467Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1237gitlab # [ 110.217838] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.471Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1238gitlab # [ 110.222949] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.476Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1239gitlab # [ 110.226670] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.480Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1240gitlab # [ 110.231218] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.485Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1241gitlab # [ 110.234805] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.488Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1242gitlab # [ 110.239390] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.493Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1243gitlab # [ 110.242855] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.496Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1244gitlab # [ 110.246472] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.500Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1245gitlab # [ 110.250783] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.504Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1246gitlab # [ 110.256268] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.510Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1247gitlab # [ 110.261839] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.515Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1248gitlab # [ 110.267299] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.521Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1249gitlab # [ 110.271880] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.525Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1250gitlab # [ 110.284561] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.538Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1251gitlab # [ 110.289442] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.542Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1252gitlab # [ 110.293315] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.547Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1253gitlab # [ 110.297773] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.551Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1254gitlab # [ 110.302257] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.556Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1255gitlab # [ 110.305874] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.559Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1256gitlab # [ 110.310326] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.564Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1257gitlab # [ 110.313863] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.567Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1258gitlab # [ 110.317706] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.571Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1259gitlab # [ 110.321905] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.575Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1260gitlab # [ 110.326053] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:21.579Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1261gitlab # [ 118.590929] gitlab-workhorse[823]: time="2026-09-09T10:33:29Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1262gitlab # [ 128.592126] gitlab-workhorse[823]: time="2026-09-09T10:33:39Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 132.083459] postgres[2133]: [2133] ERROR: relation "table_without_models" does not exist1264gitlab # [ 132.084730] postgres[2133]: [2133] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 132.559142] postgres[2144]: [2144] ERROR: relation "table_without_models" does not exist1266gitlab # [ 132.560233] postgres[2144]: [2144] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1267gitlab # [ 135.011807] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:46.265Z","message":"Booted Rails 7.2.3.1 application in production environment"}1268gitlab # [ 135.015577] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:46.269Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1269gitlab # [ 135.019549] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:46.271Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1270gitlab # [ 135.020708] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:46.271Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1271gitlab # [ 135.021572] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:46.272Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1272gitlab # [ 135.638775] bundle[1592]: {"timestamp":"2026-09-09T10:33:46.892Z","pid":1592,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1273gitlab # [ 135.639476] bundle[1592]: {"timestamp":"2026-09-09T10:33:46.892Z","pid":1592,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1274gitlab # [ 135.639896] bundle[1592]: {"timestamp":"2026-09-09T10:33:46.892Z","pid":1592,"message":"! #\u003cThread:0x0000700c09520de8 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1275gitlab # [ 135.640455] bundle[1592]: {"timestamp":"2026-09-09T10:33:46.892Z","pid":1592,"message":"! #\u003cThread:0x0000700c09824030 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1276gitlab # [ 135.640889] bundle[1592]: {"timestamp":"2026-09-09T10:33:46.892Z","pid":1592,"message":"Use Ctrl-C to stop"}1277gitlab # [ 135.641535] bundle[1592]: {"timestamp":"2026-09-09T10:33:46.892Z","pid":1592,"message":"Sending status to systemd every 1.0 sec"}1278gitlab # [ 136.057368] bundle[1592]: {"timestamp":"2026-09-09T10:33:47.311Z","pid":1592,"message":"- Worker 0 (PID: 2191) booted in 0.38s, phase: 0"}1279gitlab # [ 136.118155] bundle[1592]: {"timestamp":"2026-09-09T10:33:47.371Z","pid":1592,"message":"- Worker 1 (PID: 2195) booted in 0.43s, phase: 0"}1280gitlab # [ 136.123674] systemd[1]: Started gitlab.service.1281gitlab # [ 136.124855] systemd[1]: Reached target Common target for all GitLab services..1282gitlab # [ 136.126355] systemd[1]: Starting setup-gitlab.service...1283gitlab # [ 136.145152] setup-gitlab-start[2228]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1284gitlab # [ 137.178979] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:48.432Z","message":"Cleaning working queues"}1285gitlab # [ 137.182297] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:48.435Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"497c2467b49fc30142b3397f","created_at":"2026-09-09T10:32:45.226Z","trace_propagation_headers":{"sentry-trace":"bd6d2a10bba44e6eb28a82f57c8472d6-9224ea58e2a74543","baggage":"sentry-trace_id=bd6d2a10bba44e6eb28a82f57c8472d6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"8e085910220638feb3ee89723724dea4","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-09T10:32:45.233Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-497c2467b49fc30142b3397f: start","job_status":"start","queue_duration_s":63.202502,"scheduling_latency_s":63.202554}1286gitlab # [ 137.331094] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:33:48.584Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"497c2467b49fc30142b3397f","created_at":"2026-09-09T10:32:45.226Z","trace_propagation_headers":{"sentry-trace":"bd6d2a10bba44e6eb28a82f57c8472d6-9224ea58e2a74543","baggage":"sentry-trace_id=bd6d2a10bba44e6eb28a82f57c8472d6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"8e085910220638feb3ee89723724dea4","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-09T10:32:45.233Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-497c2467b49fc30142b3397f: done: 0.148884 sec","job_status":"done","queue_duration_s":63.202502,"scheduling_latency_s":63.202554,"redis_calls":26,"redis_duration_s":0.004642,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.002545,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000881,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07682289199999999,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.148884,"completed_at":"2026-09-09T10:33:48.584Z","load_balancing_strategy":"primary","db_duration_s":0.038156,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1287gitlab # [ 139.121592] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:33:50 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 29471288gitlab # [ 139.127439] setup-gitlab-start[2228]: + TOKEN=nixbot-test-token-of-20-chars1289gitlab # [ 139.128309] setup-gitlab-start[2228]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1290gitlab # [ 139.153720] runuser[2257]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1291gitlab # [ 139.702543] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1292gitlab # [ 139.703213] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1293gitlab # [ 139.704407] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1294gitlab # [ 140.564500] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1295gitlab # [ 140.565791] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1296gitlab # [ 140.568100] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1297gitlab # [ 156.780666] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:08.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f1b0acf1880af6a9366e8c1f","created_at":"2026-09-09T10:34:07.943Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6802feb32201176a4798e56116849fd","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.026Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f1b0acf1880af6a9366e8c1f: start","job_status":"start","queue_duration_s":0.00659,"scheduling_latency_s":0.006656}1298gitlab # [ 157.031650] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:08.283Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f1b0acf1880af6a9366e8c1f","created_at":"2026-09-09T10:34:07.943Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6802feb32201176a4798e56116849fd","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.026Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f1b0acf1880af6a9366e8c1f: done: 0.25077 sec","job_status":"done","queue_duration_s":0.00659,"scheduling_latency_s":0.006656,"redis_calls":10,"redis_duration_s":0.034228,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010851,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.021123,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000480508,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.25077,"completed_at":"2026-09-09T10:34:08.283Z","load_balancing_strategy":"primary","db_duration_s":0.069008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 157.122429] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:08.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0795964ee0c7ced6c9e2e6f7","created_at":"2026-09-09T10:34:08.055Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc7a96c13fb106ea26479d3edad3f4c5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.081Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0795964ee0c7ced6c9e2e6f7: start","job_status":"start","queue_duration_s":0.208498,"scheduling_latency_s":0.208555}1300gitlab # [ 157.178968] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:08.427Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0795964ee0c7ced6c9e2e6f7","created_at":"2026-09-09T10:34:08.055Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc7a96c13fb106ea26479d3edad3f4c5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.081Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0795964ee0c7ced6c9e2e6f7: done: 0.138151 sec","job_status":"done","queue_duration_s":0.208498,"scheduling_latency_s":0.208555,"redis_calls":12,"redis_duration_s":0.037361,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007495,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.018356,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.01151,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001183111,"exclusive_lock_hold_duration_s":0.019855037,"duration_s":0.138151,"completed_at":"2026-09-09T10:34:08.427Z","load_balancing_strategy":"primary","db_duration_s":0.009278,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 157.226653] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:08.447Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"89e435d9c21e5f9ba595d893","created_at":"2026-09-09T10:34:08.110Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f86e01a505c4cfe317fb1f1fd303eda","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.138Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-89e435d9c21e5f9ba595d893: start","job_status":"start","queue_duration_s":0.30822,"scheduling_latency_s":0.308498}1302gitlab # [ 157.385427] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:08.637Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"89e435d9c21e5f9ba595d893","created_at":"2026-09-09T10:34:08.110Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f86e01a505c4cfe317fb1f1fd303eda","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.138Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-89e435d9c21e5f9ba595d893: done: 0.190412 sec","job_status":"done","queue_duration_s":0.30822,"scheduling_latency_s":0.308498,"redis_calls":12,"redis_duration_s":0.084353,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.001601,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007324,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.072558,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001649092,"duration_s":0.190412,"completed_at":"2026-09-09T10:34:08.637Z","load_balancing_strategy":"primary","db_duration_s":0.013019,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 157.427229] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:08.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"58b780c7ca6363c4fb434e5b","created_at":"2026-09-09T10:34:08.153Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4345461a86c22caa1cff98b55550c1db","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.173Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-58b780c7ca6363c4fb434e5b: start","job_status":"start","queue_duration_s":0.480488,"scheduling_latency_s":0.480554}1304gitlab # [ 157.607426] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:08.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"58b780c7ca6363c4fb434e5b","created_at":"2026-09-09T10:34:08.153Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4345461a86c22caa1cff98b55550c1db","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.173Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-58b780c7ca6363c4fb434e5b: done: 0.20064 sec","job_status":"done","queue_duration_s":0.480488,"scheduling_latency_s":0.480554,"redis_calls":10,"redis_duration_s":0.070008,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005431,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.059403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005174,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002344152,"duration_s":0.20064,"completed_at":"2026-09-09T10:34:08.854Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 157.685607] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:08.938Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"18410346c4998d5f8669eabb","created_at":"2026-09-09T10:34:08.214Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6c9bc38460f419b7e974d5e42113b36","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:34:08.241Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-18410346c4998d5f8669eabb: start","job_status":"start","queue_duration_s":0.697428,"scheduling_latency_s":0.697495}1306gitlab # [ 157.752595] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:09.005Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1307gitlab # [ 157.791976] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:09.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"18410346c4998d5f8669eabb","created_at":"2026-09-09T10:34:08.214Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6c9bc38460f419b7e974d5e42113b36","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:34:08.241Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-18410346c4998d5f8669eabb: done: 0.101762 sec","job_status":"done","queue_duration_s":0.697428,"scheduling_latency_s":0.697495,"redis_calls":10,"redis_duration_s":0.013052,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005089,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00193,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000869664,"duration_s":0.101762,"completed_at":"2026-09-09T10:34:09.040Z","load_balancing_strategy":"primary","db_duration_s":0.004732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 157.870756] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:09.057Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4b4a7bc4896a81a8b81e4092","created_at":"2026-09-09T10:34:08.272Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f33079b55b35656bb229eaaec82cde6a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.293Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4b4a7bc4896a81a8b81e4092: start","job_status":"start","queue_duration_s":0.764494,"scheduling_latency_s":0.764557}1309gitlab # [ 158.170172] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:09.423Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4b4a7bc4896a81a8b81e4092","created_at":"2026-09-09T10:34:08.272Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f33079b55b35656bb229eaaec82cde6a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.293Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4b4a7bc4896a81a8b81e4092: done: 0.365344 sec","job_status":"done","queue_duration_s":0.764494,"scheduling_latency_s":0.764557,"redis_calls":12,"redis_duration_s":0.030214,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006497,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.015603,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.087,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002134349,"exclusive_lock_hold_duration_s":0.18975568099999998,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.365344,"completed_at":"2026-09-09T10:34:09.422Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.11998,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 158.272482] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:09.525Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"76ecc44db581c28c00729c4e","created_at":"2026-09-09T10:34:08.316Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af4673a4ad3894d5744dd5edcbb2ed1e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.347Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-76ecc44db581c28c00729c4e: start","job_status":"start","queue_duration_s":1.177757,"scheduling_latency_s":1.17782}1311gitlab # [ 158.359504] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:09.612Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1312gitlab # [ 158.403839] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:09.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"76ecc44db581c28c00729c4e","created_at":"2026-09-09T10:34:08.316Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af4673a4ad3894d5744dd5edcbb2ed1e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.347Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-76ecc44db581c28c00729c4e: done: 0.127334 sec","job_status":"done","queue_duration_s":1.177757,"scheduling_latency_s":1.17782,"redis_calls":10,"redis_duration_s":0.030979,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005554,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.022373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003052,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.012608586,"duration_s":0.127334,"completed_at":"2026-09-09T10:34:09.652Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002836,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 158.510187] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:09.763Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"571f7d0a7faf9534a6513207","created_at":"2026-09-09T10:34:08.378Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"021ecc931c30b6ca70ac2d9d2a36ac6a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:34:08.415Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-571f7d0a7faf9534a6513207: start","job_status":"start","queue_duration_s":1.347871,"scheduling_latency_s":1.347943}1314gitlab # [ 158.608825] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:09.862Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1315gitlab # [ 158.672002] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:09.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"571f7d0a7faf9534a6513207","created_at":"2026-09-09T10:34:08.378Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"021ecc931c30b6ca70ac2d9d2a36ac6a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:34:08.415Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-571f7d0a7faf9534a6513207: done: 0.161631 sec","job_status":"done","queue_duration_s":1.347871,"scheduling_latency_s":1.347943,"redis_calls":10,"redis_duration_s":0.051956999999999996,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003566,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.041961,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001320838,"duration_s":0.161631,"completed_at":"2026-09-09T10:34:09.924Z","load_balancing_strategy":"primary","db_duration_s":0.001908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 158.745988] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:09.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"63764ab4afca9610e9054ebc","created_at":"2026-09-09T10:34:08.422Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1cb9680e7fbc555e7d59adce78fc466","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.461Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-63764ab4afca9610e9054ebc: start","job_status":"start","queue_duration_s":1.537441,"scheduling_latency_s":1.537498}1317gitlab # [ 159.552227] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:10.803Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"63764ab4afca9610e9054ebc","created_at":"2026-09-09T10:34:08.422Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1cb9680e7fbc555e7d59adce78fc466","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.461Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-63764ab4afca9610e9054ebc: done: 0.804669 sec","job_status":"done","queue_duration_s":1.537441,"scheduling_latency_s":1.537498,"redis_calls":14,"redis_duration_s":0.028443000000000003,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.018582,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004242,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.136,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.136,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.526679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001743517,"exclusive_lock_hold_duration_s":0.701886972,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.804669,"completed_at":"2026-09-09T10:34:10.803Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.231741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 159.637810] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:10.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"6fd62dbfbd33d15be6804d77","created_at":"2026-09-09T10:34:08.563Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a842946f0de4cdcb1ca0d8bbc18f10de","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.596Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-6fd62dbfbd33d15be6804d77: start","job_status":"start","queue_duration_s":2.292189,"scheduling_latency_s":2.292255}1319gitlab # [ 160.779322] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.030Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"6fd62dbfbd33d15be6804d77","created_at":"2026-09-09T10:34:08.563Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a842946f0de4cdcb1ca0d8bbc18f10de","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.596Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-6fd62dbfbd33d15be6804d77: done: 1.141398 sec","job_status":"done","queue_duration_s":2.292189,"scheduling_latency_s":2.292255,"redis_calls":565,"redis_duration_s":0.337791,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000981,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003382,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.333428,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.815903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000826642,"duration_s":1.141398,"completed_at":"2026-09-09T10:34:12.029Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 160.873905] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e425fb5cf959c31d3d04b9f2","created_at":"2026-09-09T10:34:08.639Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad76a2fcf23c6f6bb36b9f0f2551270e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.685Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e425fb5cf959c31d3d04b9f2: start","job_status":"start","queue_duration_s":3.441247,"scheduling_latency_s":3.441301}1321gitlab # [ 160.922993] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e425fb5cf959c31d3d04b9f2","created_at":"2026-09-09T10:34:08.639Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad76a2fcf23c6f6bb36b9f0f2551270e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.685Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e425fb5cf959c31d3d04b9f2: done: 0.048904 sec","job_status":"done","queue_duration_s":3.441247,"scheduling_latency_s":3.441301,"redis_calls":10,"redis_duration_s":0.008198,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000757,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004652,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000757639,"duration_s":0.048904,"completed_at":"2026-09-09T10:34:12.175Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 161.021435] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.274Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"515f9a6240e90889c7af5bfc","created_at":"2026-09-09T10:34:08.793Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39a77c211b7c33d54f26b1b0b723cbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.832Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-515f9a6240e90889c7af5bfc: start","job_status":"start","queue_duration_s":3.44234,"scheduling_latency_s":3.442392}1323gitlab # [ 161.071714] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.324Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"515f9a6240e90889c7af5bfc","created_at":"2026-09-09T10:34:08.793Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39a77c211b7c33d54f26b1b0b723cbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.832Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-515f9a6240e90889c7af5bfc: done: 0.050013 sec","job_status":"done","queue_duration_s":3.44234,"scheduling_latency_s":3.442392,"redis_calls":12,"redis_duration_s":0.010925,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005049,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003738,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000859606,"duration_s":0.050013,"completed_at":"2026-09-09T10:34:12.324Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002026,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 161.112931] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.327Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"84a155cd43add39d5a684dab","created_at":"2026-09-09T10:34:08.934Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acb3880401384fd3235c05e32dda5dfb","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.992Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-84a155cd43add39d5a684dab: start","job_status":"start","queue_duration_s":3.334846,"scheduling_latency_s":3.334889}1325gitlab # [ 161.148604] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.401Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"84a155cd43add39d5a684dab","created_at":"2026-09-09T10:34:08.934Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acb3880401384fd3235c05e32dda5dfb","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:08.992Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-84a155cd43add39d5a684dab: done: 0.074043 sec","job_status":"done","queue_duration_s":3.334846,"scheduling_latency_s":3.334889,"redis_calls":13,"redis_duration_s":0.00607,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000959,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002908,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002203,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.027280002999999997,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.074043,"completed_at":"2026-09-09T10:34:12.401Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013521,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1326gitlab # [ 161.235312] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.404Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"82b0a5f54443a9757a1bd762","created_at":"2026-09-09T10:34:09.046Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cccf0dfba552be2be18f20fb1576baa","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.110Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-82b0a5f54443a9757a1bd762: start","job_status":"start","queue_duration_s":3.294087,"scheduling_latency_s":3.294132}1327gitlab # [ 161.237314] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"82b0a5f54443a9757a1bd762","created_at":"2026-09-09T10:34:09.046Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cccf0dfba552be2be18f20fb1576baa","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.110Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-82b0a5f54443a9757a1bd762: done: 0.045161 sec","job_status":"done","queue_duration_s":3.294087,"scheduling_latency_s":3.294132,"redis_calls":12,"redis_duration_s":0.005579,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000968,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002602,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002009,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001191771,"exclusive_lock_hold_duration_s":0.006491328,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.045161,"completed_at":"2026-09-09T10:34:12.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00308,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 161.321270] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4352bd52fee8336f16264267","created_at":"2026-09-09T10:34:09.125Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.151Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4352bd52fee8336f16264267: start","job_status":"start","queue_duration_s":3.301318,"scheduling_latency_s":3.301367}1329gitlab # [ 161.554644] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4352bd52fee8336f16264267","created_at":"2026-09-09T10:34:09.125Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.151Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4352bd52fee8336f16264267: done: 0.353724 sec","job_status":"done","queue_duration_s":3.301318,"scheduling_latency_s":3.301367,"redis_calls":71,"redis_duration_s":0.098795,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.016699,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001757,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.076691,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003648,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.23993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002149436,"duration_s":0.353724,"completed_at":"2026-09-09T10:34:12.806Z","load_balancing_strategy":"primary","db_duration_s":0.00649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 161.660866] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:12.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"177c7f79f3ac508ad16201b0","created_at":"2026-09-09T10:34:09.171Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47bbd27b4ce895e40e691673d4495513","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:34:09.228Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-177c7f79f3ac508ad16201b0: start","job_status":"start","queue_duration_s":3.682535,"scheduling_latency_s":3.682597}1331gitlab # [ 161.748786] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.000Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"177c7f79f3ac508ad16201b0","created_at":"2026-09-09T10:34:09.171Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47bbd27b4ce895e40e691673d4495513","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:34:09.228Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-177c7f79f3ac508ad16201b0: done: 0.090041 sec","job_status":"done","queue_duration_s":3.682535,"scheduling_latency_s":3.682597,"redis_calls":10,"redis_duration_s":0.009885999999999999,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001684,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00552,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002682,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002342477,"duration_s":0.090041,"completed_at":"2026-09-09T10:34:13.000Z","load_balancing_strategy":"primary","db_duration_s":0.009863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 161.760966] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.009Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3e3364fde23dd340d7f35a5e","created_at":"2026-09-09T10:34:09.287Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfe1d04efb9210a490be5ab90dd8ec3d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.309Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3e3364fde23dd340d7f35a5e: start","job_status":"start","queue_duration_s":3.699983,"scheduling_latency_s":3.700041}1333gitlab # [ 161.878106] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.128Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3e3364fde23dd340d7f35a5e","created_at":"2026-09-09T10:34:09.287Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfe1d04efb9210a490be5ab90dd8ec3d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.309Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3e3364fde23dd340d7f35a5e: done: 0.119129 sec","job_status":"done","queue_duration_s":3.699983,"scheduling_latency_s":3.700041,"redis_calls":16,"redis_duration_s":0.020112,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.011433,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00594,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002739,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002249169,"duration_s":0.119129,"completed_at":"2026-09-09T10:34:13.128Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 161.886073] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e0bd4965051628fac7c8a987","created_at":"2026-09-09T10:34:09.353Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6cec37b48eabe91cb4b68f1caf2a40ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.380Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e0bd4965051628fac7c8a987: start","job_status":"start","queue_duration_s":3.759143,"scheduling_latency_s":3.759201}1335gitlab # [ 161.917876] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.171Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1336gitlab # [ 161.933154] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e0bd4965051628fac7c8a987","created_at":"2026-09-09T10:34:09.353Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6cec37b48eabe91cb4b68f1caf2a40ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.380Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e0bd4965051628fac7c8a987: done: 0.046977 sec","job_status":"done","queue_duration_s":3.759143,"scheduling_latency_s":3.759201,"redis_calls":10,"redis_duration_s":0.007202,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000995,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00075708,"duration_s":0.046977,"completed_at":"2026-09-09T10:34:13.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00121,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 162.096316] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"53dfed8d93a5216caae94503","created_at":"2026-09-09T10:34:09.398Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b700e1a1e82e2999836af57176b5cf63","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.559Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-53dfed8d93a5216caae94503: start","job_status":"start","queue_duration_s":3.633364,"scheduling_latency_s":3.633418}1338gitlab # [ 162.099893] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.233Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1339gitlab # [ 162.100987] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"53dfed8d93a5216caae94503","created_at":"2026-09-09T10:34:09.398Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b700e1a1e82e2999836af57176b5cf63","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.559Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-53dfed8d93a5216caae94503: done: 0.059583 sec","job_status":"done","queue_duration_s":3.633364,"scheduling_latency_s":3.633418,"redis_calls":10,"redis_duration_s":0.011432,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003869,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002447,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000802895,"duration_s":0.059583,"completed_at":"2026-09-09T10:34:13.252Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 162.231739] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.256Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ce53ec98cec1a4edc93096b2","created_at":"2026-09-09T10:34:09.588Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e38e0ff47c1aa545ce35584e5dd58059","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.630Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ce53ec98cec1a4edc93096b2: start","job_status":"start","queue_duration_s":3.625484,"scheduling_latency_s":3.625534}1341gitlab # [ 162.233573] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.284Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1342gitlab # [ 162.235884] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.308Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ce53ec98cec1a4edc93096b2","created_at":"2026-09-09T10:34:09.588Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e38e0ff47c1aa545ce35584e5dd58059","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.630Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ce53ec98cec1a4edc93096b2: done: 0.052005 sec","job_status":"done","queue_duration_s":3.625484,"scheduling_latency_s":3.625534,"redis_calls":10,"redis_duration_s":0.007646,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001207,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003513,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002926,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000943974,"duration_s":0.052005,"completed_at":"2026-09-09T10:34:13.308Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001112,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 162.357264] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"732121981080d62202591a62","created_at":"2026-09-09T10:34:09.741Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b802e45b34a7afb1979a72fe465a96ca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.799Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-732121981080d62202591a62: start","job_status":"start","queue_duration_s":3.513344,"scheduling_latency_s":3.513398}1344gitlab # [ 162.375398] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"732121981080d62202591a62","created_at":"2026-09-09T10:34:09.741Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b802e45b34a7afb1979a72fe465a96ca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.799Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-732121981080d62202591a62: done: 0.31474 sec","job_status":"done","queue_duration_s":3.513344,"scheduling_latency_s":3.513398,"redis_calls":14,"redis_duration_s":0.012695,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002101,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006405,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004189,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.221,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.218,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001383136,"exclusive_lock_hold_duration_s":0.250529047,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.31474,"completed_at":"2026-09-09T10:34:13.626Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.222419,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 162.495409] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.648Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"4710eaac22b1306b593d3d9d","created_at":"2026-09-09T10:34:09.815Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4befb8465cf32eada93f874ac7b23b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.851Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-4710eaac22b1306b593d3d9d: start","job_status":"start","queue_duration_s":3.796531,"scheduling_latency_s":3.796594}1346gitlab # [ 162.515083] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"4710eaac22b1306b593d3d9d","created_at":"2026-09-09T10:34:09.815Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4befb8465cf32eada93f874ac7b23b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:09.851Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-4710eaac22b1306b593d3d9d: done: 0.1185 sec","job_status":"done","queue_duration_s":3.796531,"scheduling_latency_s":3.796594,"redis_calls":19,"redis_duration_s":0.029507,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005414,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.001991,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.020161,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001044826,"duration_s":0.1185,"completed_at":"2026-09-09T10:34:13.766Z","load_balancing_strategy":"primary","db_duration_s":0.005661,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 162.534257] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.787Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7399f779f4983e2a5c9b19c0","created_at":"2026-09-09T10:34:09.911Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f3ff2c44dc5a5234621769967a7a6ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:10.035Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7399f779f4983e2a5c9b19c0: start","job_status":"start","queue_duration_s":3.751671,"scheduling_latency_s":3.751734}1348gitlab # [ 162.603163] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.848Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7399f779f4983e2a5c9b19c0","created_at":"2026-09-09T10:34:09.911Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f3ff2c44dc5a5234621769967a7a6ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:10.035Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7399f779f4983e2a5c9b19c0: done: 0.060921 sec","job_status":"done","queue_duration_s":3.751671,"scheduling_latency_s":3.751734,"redis_calls":10,"redis_duration_s":0.01728,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003077,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003975,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003370819,"duration_s":0.060921,"completed_at":"2026-09-09T10:34:13.847Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 162.623064] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"a5593b75a58c47f68e1a2f9d","created_at":"2026-09-09T10:34:10.076Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"514ed3e534311a11b7b44579111c37fe","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:10.114Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-a5593b75a58c47f68e1a2f9d: start","job_status":"start","queue_duration_s":3.744544,"scheduling_latency_s":3.744615}1350gitlab # [ 162.695534] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"a5593b75a58c47f68e1a2f9d","created_at":"2026-09-09T10:34:10.076Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"514ed3e534311a11b7b44579111c37fe","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-09T10:34:10.114Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-a5593b75a58c47f68e1a2f9d: done: 0.06269 sec","job_status":"done","queue_duration_s":3.744544,"scheduling_latency_s":3.744615,"redis_calls":12,"redis_duration_s":0.008631,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003064,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001508572,"exclusive_lock_hold_duration_s":0.010754439999999999,"duration_s":0.06269,"completed_at":"2026-09-09T10:34:13.921Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004446,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 162.720331] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:13.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c7579a470cb08be8b2fc21d","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c7579a470cb08be8b2fc21d: start","job_status":"start","queue_duration_s":1.151411,"scheduling_latency_s":1.151461}1352gitlab # [ 162.792752] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c7579a470cb08be8b2fc21d","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c7579a470cb08be8b2fc21d: done: 0.075617 sec","job_status":"done","queue_duration_s":1.151411,"scheduling_latency_s":1.151461,"redis_calls":16,"redis_duration_s":0.013113,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003633,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006927,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000745626,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.075617,"completed_at":"2026-09-09T10:34:14.001Z","load_balancing_strategy":"primary","db_duration_s":0.002491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 162.799276] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de2cc63458a1311c8d0bbdfc","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de2cc63458a1311c8d0bbdfc: start","job_status":"start","queue_duration_s":1.237874,"scheduling_latency_s":1.237932}1354gitlab # [ 162.889423] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de2cc63458a1311c8d0bbdfc","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de2cc63458a1311c8d0bbdfc: done: 0.127516 sec","job_status":"done","queue_duration_s":1.237874,"scheduling_latency_s":1.237932,"redis_calls":13,"redis_duration_s":0.080833,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.073615,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.127516,"completed_at":"2026-09-09T10:34:14.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 162.890185] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f55ca1d579c01df53c7dcde","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f55ca1d579c01df53c7dcde: start","job_status":"start","queue_duration_s":1.368077,"scheduling_latency_s":1.368123}1356gitlab # [ 162.963497] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f55ca1d579c01df53c7dcde","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f55ca1d579c01df53c7dcde: done: 0.031676 sec","job_status":"done","queue_duration_s":1.368077,"scheduling_latency_s":1.368123,"redis_calls":13,"redis_duration_s":0.004241,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031676,"completed_at":"2026-09-09T10:34:14.174Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 162.969222] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b7695262ff3a257e4fdde91","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b7695262ff3a257e4fdde91: start","job_status":"start","queue_duration_s":1.402477,"scheduling_latency_s":1.402519}1358gitlab # [ 162.994371] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b7695262ff3a257e4fdde91","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b7695262ff3a257e4fdde91: done: 0.034732 sec","job_status":"done","queue_duration_s":1.402477,"scheduling_latency_s":1.402519,"redis_calls":13,"redis_duration_s":0.004239,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034732,"completed_at":"2026-09-09T10:34:14.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 163.087921] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bdb9c38dd84b0cd45fcccdf","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bdb9c38dd84b0cd45fcccdf: start","job_status":"start","queue_duration_s":1.440408,"scheduling_latency_s":1.440459}1360gitlab # [ 163.089772] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bdb9c38dd84b0cd45fcccdf","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bdb9c38dd84b0cd45fcccdf: done: 0.03645 sec","job_status":"done","queue_duration_s":1.440408,"scheduling_latency_s":1.440459,"redis_calls":13,"redis_duration_s":0.004994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00141,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003584,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03645,"completed_at":"2026-09-09T10:34:14.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 163.202810] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"183e17c39cccfbc2455f9442","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-183e17c39cccfbc2455f9442: start","job_status":"start","queue_duration_s":1.479373,"scheduling_latency_s":1.479418}1362gitlab # [ 163.204118] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"183e17c39cccfbc2455f9442","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-183e17c39cccfbc2455f9442: done: 0.030086 sec","job_status":"done","queue_duration_s":1.479373,"scheduling_latency_s":1.479418,"redis_calls":13,"redis_duration_s":0.0034460000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001158,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002288,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030086,"completed_at":"2026-09-09T10:34:14.284Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 163.284162] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79c48207c127564d871a9acc","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79c48207c127564d871a9acc: start","job_status":"start","queue_duration_s":1.512051,"scheduling_latency_s":1.512097}1364gitlab # [ 163.285745] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79c48207c127564d871a9acc","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79c48207c127564d871a9acc: done: 0.03273 sec","job_status":"done","queue_duration_s":1.512051,"scheduling_latency_s":1.512097,"redis_calls":13,"redis_duration_s":0.003737,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001367,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00237,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03273,"completed_at":"2026-09-09T10:34:14.319Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 163.326368] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e385bfe6aa22ba849f0a3c6e","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e385bfe6aa22ba849f0a3c6e: start","job_status":"start","queue_duration_s":1.548298,"scheduling_latency_s":1.548348}1366gitlab # [ 163.403242] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e385bfe6aa22ba849f0a3c6e","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e385bfe6aa22ba849f0a3c6e: done: 0.039952 sec","job_status":"done","queue_duration_s":1.548298,"scheduling_latency_s":1.548348,"redis_calls":13,"redis_duration_s":0.004657,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039952,"completed_at":"2026-09-09T10:34:14.362Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 163.407128] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3fd40a71fc4252c3392c127","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3fd40a71fc4252c3392c127: start","job_status":"start","queue_duration_s":1.591458,"scheduling_latency_s":1.59151}1368gitlab # [ 163.501280] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3fd40a71fc4252c3392c127","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3fd40a71fc4252c3392c127: done: 0.038461 sec","job_status":"done","queue_duration_s":1.591458,"scheduling_latency_s":1.59151,"redis_calls":13,"redis_duration_s":0.004574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038461,"completed_at":"2026-09-09T10:34:14.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 163.502931] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac91643c61517a8c63bd7a02","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac91643c61517a8c63bd7a02: start","job_status":"start","queue_duration_s":1.63354,"scheduling_latency_s":1.633594}1370gitlab # [ 163.604484] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac91643c61517a8c63bd7a02","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac91643c61517a8c63bd7a02: done: 0.040277 sec","job_status":"done","queue_duration_s":1.63354,"scheduling_latency_s":1.633594,"redis_calls":13,"redis_duration_s":0.005019,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003426,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040277,"completed_at":"2026-09-09T10:34:14.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 163.611485] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a686e96a06e31a5fbf9a506","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a686e96a06e31a5fbf9a506: start","job_status":"start","queue_duration_s":1.677417,"scheduling_latency_s":1.677471}1372gitlab # [ 163.637394] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a686e96a06e31a5fbf9a506","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a686e96a06e31a5fbf9a506: done: 0.038542 sec","job_status":"done","queue_duration_s":1.677417,"scheduling_latency_s":1.677471,"redis_calls":13,"redis_duration_s":0.0059229999999999994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004455,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038542,"completed_at":"2026-09-09T10:34:14.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 163.761864] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"794515b826564ff4df5dbd74","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-794515b826564ff4df5dbd74: start","job_status":"start","queue_duration_s":1.719872,"scheduling_latency_s":1.719924}1374gitlab # [ 163.763638] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"794515b826564ff4df5dbd74","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-794515b826564ff4df5dbd74: done: 0.034389 sec","job_status":"done","queue_duration_s":1.719872,"scheduling_latency_s":1.719924,"redis_calls":13,"redis_duration_s":0.004042,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001439,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002603,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034389,"completed_at":"2026-09-09T10:34:14.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 163.846454] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6aadafdfd57a12807a4d517","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6aadafdfd57a12807a4d517: start","job_status":"start","queue_duration_s":1.758116,"scheduling_latency_s":1.75821}1376gitlab # [ 163.846802] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6aadafdfd57a12807a4d517","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6aadafdfd57a12807a4d517: done: 0.034823 sec","job_status":"done","queue_duration_s":1.758116,"scheduling_latency_s":1.75821,"redis_calls":13,"redis_duration_s":0.004554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00171,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002844,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034823,"completed_at":"2026-09-09T10:34:14.567Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 163.947340] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0780f7a887159662a3478553","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0780f7a887159662a3478553: start","job_status":"start","queue_duration_s":1.795502,"scheduling_latency_s":1.795547}1378gitlab # [ 163.948631] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0780f7a887159662a3478553","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0780f7a887159662a3478553: done: 0.029546 sec","job_status":"done","queue_duration_s":1.795502,"scheduling_latency_s":1.795547,"redis_calls":13,"redis_duration_s":0.00368,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002439,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029546,"completed_at":"2026-09-09T10:34:14.599Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 164.034285] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"461b1345ef4124c9a94c3d77","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-461b1345ef4124c9a94c3d77: start","job_status":"start","queue_duration_s":1.827759,"scheduling_latency_s":1.827822}1380gitlab # [ 164.120307] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"461b1345ef4124c9a94c3d77","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-461b1345ef4124c9a94c3d77: done: 0.030863 sec","job_status":"done","queue_duration_s":1.827759,"scheduling_latency_s":1.827822,"redis_calls":13,"redis_duration_s":0.0037619999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001302,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00246,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030863,"completed_at":"2026-09-09T10:34:14.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 164.123831] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75e37b021fae31541466df5f","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75e37b021fae31541466df5f: start","job_status":"start","queue_duration_s":1.861326,"scheduling_latency_s":1.861374}1382gitlab # [ 164.228304] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75e37b021fae31541466df5f","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75e37b021fae31541466df5f: done: 0.032872 sec","job_status":"done","queue_duration_s":1.861326,"scheduling_latency_s":1.861374,"redis_calls":13,"redis_duration_s":0.004191,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002772,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032872,"completed_at":"2026-09-09T10:34:14.668Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 164.230231] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa1ab2f61238034aae4f0183","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa1ab2f61238034aae4f0183: start","job_status":"start","queue_duration_s":1.897342,"scheduling_latency_s":1.897387}1384gitlab # [ 164.301131] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa1ab2f61238034aae4f0183","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa1ab2f61238034aae4f0183: done: 0.035386 sec","job_status":"done","queue_duration_s":1.897342,"scheduling_latency_s":1.897387,"redis_calls":13,"redis_duration_s":0.0051920000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003625,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035386,"completed_at":"2026-09-09T10:34:14.707Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 164.309638] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3568f452c5cc5f41fa0a1f9f","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3568f452c5cc5f41fa0a1f9f: start","job_status":"start","queue_duration_s":1.935697,"scheduling_latency_s":1.935742}1386gitlab # [ 164.381959] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3568f452c5cc5f41fa0a1f9f","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3568f452c5cc5f41fa0a1f9f: done: 0.041376 sec","job_status":"done","queue_duration_s":1.935697,"scheduling_latency_s":1.935742,"redis_calls":13,"redis_duration_s":0.006553999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002106,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004448,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041376,"completed_at":"2026-09-09T10:34:14.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 164.402130] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbd05a4cd0e39e44e48d3d81","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbd05a4cd0e39e44e48d3d81: start","job_status":"start","queue_duration_s":1.9886,"scheduling_latency_s":1.988658}1388gitlab # [ 164.496530] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbd05a4cd0e39e44e48d3d81","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbd05a4cd0e39e44e48d3d81: done: 0.029152 sec","job_status":"done","queue_duration_s":1.9886,"scheduling_latency_s":1.988658,"redis_calls":13,"redis_duration_s":0.003735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002517,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029152,"completed_at":"2026-09-09T10:34:14.792Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 164.499354] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3a3dd586522f3d1c29755d9","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3a3dd586522f3d1c29755d9: start","job_status":"start","queue_duration_s":2.020315,"scheduling_latency_s":2.020355}1390gitlab # [ 164.527119] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3a3dd586522f3d1c29755d9","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3a3dd586522f3d1c29755d9: done: 0.024744 sec","job_status":"done","queue_duration_s":2.020315,"scheduling_latency_s":2.020355,"redis_calls":13,"redis_duration_s":0.003221,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024744,"completed_at":"2026-09-09T10:34:14.819Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 164.648382] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9801cc75df62a1f635d6dc7","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9801cc75df62a1f635d6dc7: start","job_status":"start","queue_duration_s":2.051391,"scheduling_latency_s":2.05144}1392gitlab # [ 164.649921] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9801cc75df62a1f635d6dc7","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9801cc75df62a1f635d6dc7: done: 0.032256 sec","job_status":"done","queue_duration_s":2.051391,"scheduling_latency_s":2.05144,"redis_calls":13,"redis_duration_s":0.003606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001264,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002342,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032256,"completed_at":"2026-09-09T10:34:14.858Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 164.688710] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa7fcf908aef79730a99a777","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa7fcf908aef79730a99a777: start","job_status":"start","queue_duration_s":2.087119,"scheduling_latency_s":2.087161}1394gitlab # [ 164.713760] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa7fcf908aef79730a99a777","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa7fcf908aef79730a99a777: done: 0.024924 sec","job_status":"done","queue_duration_s":2.087119,"scheduling_latency_s":2.087161,"redis_calls":13,"redis_duration_s":0.0033369999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024924,"completed_at":"2026-09-09T10:34:14.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 164.814101] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a581cd5bf683db0a11522939","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a581cd5bf683db0a11522939: start","job_status":"start","queue_duration_s":2.114994,"scheduling_latency_s":2.115035}1396gitlab # [ 164.815738] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a581cd5bf683db0a11522939","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a581cd5bf683db0a11522939: done: 0.025031 sec","job_status":"done","queue_duration_s":2.114994,"scheduling_latency_s":2.115035,"redis_calls":13,"redis_duration_s":0.003783,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025031,"completed_at":"2026-09-09T10:34:14.914Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 164.878874] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcb281218f2c3146dea2f237","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcb281218f2c3146dea2f237: start","job_status":"start","queue_duration_s":2.142231,"scheduling_latency_s":2.142271}1398gitlab # [ 164.896801] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcb281218f2c3146dea2f237","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcb281218f2c3146dea2f237: done: 0.024596 sec","job_status":"done","queue_duration_s":2.142231,"scheduling_latency_s":2.142271,"redis_calls":13,"redis_duration_s":0.003458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00244,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024596,"completed_at":"2026-09-09T10:34:14.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 164.963786] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30390654477fbff935d77809","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30390654477fbff935d77809: start","job_status":"start","queue_duration_s":2.169058,"scheduling_latency_s":2.169099}1400gitlab # [ 164.973071] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30390654477fbff935d77809","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30390654477fbff935d77809: done: 0.02739 sec","job_status":"done","queue_duration_s":2.169058,"scheduling_latency_s":2.169099,"redis_calls":13,"redis_duration_s":0.003775,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002429,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02739,"completed_at":"2026-09-09T10:34:14.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 165.037581] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:14.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"095a6e0cd5ca73f7278c1118","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-095a6e0cd5ca73f7278c1118: start","job_status":"start","queue_duration_s":2.199273,"scheduling_latency_s":2.199318}1402gitlab # [ 165.107102] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"095a6e0cd5ca73f7278c1118","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-095a6e0cd5ca73f7278c1118: done: 0.028447 sec","job_status":"done","queue_duration_s":2.199273,"scheduling_latency_s":2.199318,"redis_calls":13,"redis_duration_s":0.003952,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001454,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002498,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028447,"completed_at":"2026-09-09T10:34:15.002Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 165.115287] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"383b3fb00f96bdf15d034bb4","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-383b3fb00f96bdf15d034bb4: start","job_status":"start","queue_duration_s":2.230427,"scheduling_latency_s":2.23047}1404gitlab # [ 165.134302] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"383b3fb00f96bdf15d034bb4","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-383b3fb00f96bdf15d034bb4: done: 0.026787 sec","job_status":"done","queue_duration_s":2.230427,"scheduling_latency_s":2.23047,"redis_calls":13,"redis_duration_s":0.003489,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001176,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002313,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026787,"completed_at":"2026-09-09T10:34:15.031Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 165.244173] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28581dc601ac06fc8f2555eb","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28581dc601ac06fc8f2555eb: start","job_status":"start","queue_duration_s":2.260456,"scheduling_latency_s":2.260502}1406gitlab # [ 165.245498] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28581dc601ac06fc8f2555eb","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28581dc601ac06fc8f2555eb: done: 0.025832 sec","job_status":"done","queue_duration_s":2.260456,"scheduling_latency_s":2.260502,"redis_calls":13,"redis_duration_s":0.0036030000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001309,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002294,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025832,"completed_at":"2026-09-09T10:34:15.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 165.330550] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e76d9d395886d9c7d640400","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e76d9d395886d9c7d640400: start","job_status":"start","queue_duration_s":2.288754,"scheduling_latency_s":2.288819}1408gitlab # [ 165.331910] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e76d9d395886d9c7d640400","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e76d9d395886d9c7d640400: done: 0.027077 sec","job_status":"done","queue_duration_s":2.288754,"scheduling_latency_s":2.288819,"redis_calls":13,"redis_duration_s":0.003724,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001382,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002342,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027077,"completed_at":"2026-09-09T10:34:15.090Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 165.418248] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e702981c74c9eda1b700f669","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e702981c74c9eda1b700f669: start","job_status":"start","queue_duration_s":2.318817,"scheduling_latency_s":2.318863}1410gitlab # [ 165.420391] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e702981c74c9eda1b700f669","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e702981c74c9eda1b700f669: done: 0.027854 sec","job_status":"done","queue_duration_s":2.318817,"scheduling_latency_s":2.318863,"redis_calls":13,"redis_duration_s":0.003809,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002492,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027854,"completed_at":"2026-09-09T10:34:15.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 165.490194] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a12db6578fac58976492f79","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a12db6578fac58976492f79: start","job_status":"start","queue_duration_s":2.349268,"scheduling_latency_s":2.349313}1412gitlab # [ 165.491322] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a12db6578fac58976492f79","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a12db6578fac58976492f79: done: 0.02814 sec","job_status":"done","queue_duration_s":2.349268,"scheduling_latency_s":2.349313,"redis_calls":13,"redis_duration_s":0.004145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00172,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002425,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02814,"completed_at":"2026-09-09T10:34:15.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 165.571261] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdd4893dc4d998084138b40e","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdd4893dc4d998084138b40e: start","job_status":"start","queue_duration_s":2.379918,"scheduling_latency_s":2.379963}1414gitlab # [ 165.573746] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdd4893dc4d998084138b40e","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdd4893dc4d998084138b40e: done: 0.029453 sec","job_status":"done","queue_duration_s":2.379918,"scheduling_latency_s":2.379963,"redis_calls":13,"redis_duration_s":0.004053,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002622,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029453,"completed_at":"2026-09-09T10:34:15.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 165.677755] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fe0c17a51426d7a0234a0e8","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fe0c17a51426d7a0234a0e8: start","job_status":"start","queue_duration_s":2.411489,"scheduling_latency_s":2.411524}1416gitlab # [ 165.679091] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fe0c17a51426d7a0234a0e8","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fe0c17a51426d7a0234a0e8: done: 0.024913 sec","job_status":"done","queue_duration_s":2.411489,"scheduling_latency_s":2.411524,"redis_calls":13,"redis_duration_s":0.003614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001157,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002457,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024913,"completed_at":"2026-09-09T10:34:15.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 165.694933] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8e416681068bc69dd852fa9","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8e416681068bc69dd852fa9: start","job_status":"start","queue_duration_s":2.439044,"scheduling_latency_s":2.439091}1418gitlab # [ 165.714367] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8e416681068bc69dd852fa9","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8e416681068bc69dd852fa9: done: 0.027424 sec","job_status":"done","queue_duration_s":2.439044,"scheduling_latency_s":2.439091,"redis_calls":13,"redis_duration_s":0.004163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002842,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027424,"completed_at":"2026-09-09T10:34:15.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 165.788717] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"002845d409dc652b3cb4439e","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-002845d409dc652b3cb4439e: start","job_status":"start","queue_duration_s":2.468863,"scheduling_latency_s":2.468906}1420gitlab # [ 165.857610] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.268Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"002845d409dc652b3cb4439e","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-002845d409dc652b3cb4439e: done: 0.025047 sec","job_status":"done","queue_duration_s":2.468863,"scheduling_latency_s":2.468906,"redis_calls":13,"redis_duration_s":0.0032319999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025047,"completed_at":"2026-09-09T10:34:15.268Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 165.860387] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33e9a66f429dfd71895da5b6","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33e9a66f429dfd71895da5b6: start","job_status":"start","queue_duration_s":2.496667,"scheduling_latency_s":2.49671}1422gitlab # [ 165.875657] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33e9a66f429dfd71895da5b6","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33e9a66f429dfd71895da5b6: done: 0.027802 sec","job_status":"done","queue_duration_s":2.496667,"scheduling_latency_s":2.49671,"redis_calls":13,"redis_duration_s":0.003981999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001425,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002557,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027802,"completed_at":"2026-09-09T10:34:15.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 165.947373] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b7b3f00b3d2f3f300782444","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b7b3f00b3d2f3f300782444: start","job_status":"start","queue_duration_s":2.527533,"scheduling_latency_s":2.52758}1424gitlab # [ 165.948867] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b7b3f00b3d2f3f300782444","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b7b3f00b3d2f3f300782444: done: 0.0281 sec","job_status":"done","queue_duration_s":2.527533,"scheduling_latency_s":2.52758,"redis_calls":13,"redis_duration_s":0.003846,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0281,"completed_at":"2026-09-09T10:34:15.330Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 166.013775] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"713eeca60881f1ee58db39ce","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-713eeca60881f1ee58db39ce: start","job_status":"start","queue_duration_s":2.55788,"scheduling_latency_s":2.557923}1426gitlab # [ 166.091766] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"713eeca60881f1ee58db39ce","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-713eeca60881f1ee58db39ce: done: 0.027297 sec","job_status":"done","queue_duration_s":2.55788,"scheduling_latency_s":2.557923,"redis_calls":13,"redis_duration_s":0.003817,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002443,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027297,"completed_at":"2026-09-09T10:34:15.359Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 166.094721] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd30e9f71d51e055905f78f9","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd30e9f71d51e055905f78f9: start","job_status":"start","queue_duration_s":2.587761,"scheduling_latency_s":2.587825}1428gitlab # [ 166.114837] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd30e9f71d51e055905f78f9","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd30e9f71d51e055905f78f9: done: 0.027993 sec","job_status":"done","queue_duration_s":2.587761,"scheduling_latency_s":2.587825,"redis_calls":13,"redis_duration_s":0.003988,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002554,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027993,"completed_at":"2026-09-09T10:34:15.390Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 166.192234] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de8d3d9afb1fef35633b1a36","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de8d3d9afb1fef35633b1a36: start","job_status":"start","queue_duration_s":2.618482,"scheduling_latency_s":2.618524}1430gitlab # [ 166.193479] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de8d3d9afb1fef35633b1a36","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de8d3d9afb1fef35633b1a36: done: 0.029037 sec","job_status":"done","queue_duration_s":2.618482,"scheduling_latency_s":2.618524,"redis_calls":13,"redis_duration_s":0.004103,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00144,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002663,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029037,"completed_at":"2026-09-09T10:34:15.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 166.264236] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01a1348787e3baec62f552ec","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01a1348787e3baec62f552ec: start","job_status":"start","queue_duration_s":2.650148,"scheduling_latency_s":2.650254}1432gitlab # [ 166.266748] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01a1348787e3baec62f552ec","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01a1348787e3baec62f552ec: done: 0.027811 sec","job_status":"done","queue_duration_s":2.650148,"scheduling_latency_s":2.650254,"redis_calls":13,"redis_duration_s":0.0041329999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001723,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027811,"completed_at":"2026-09-09T10:34:15.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 166.346650] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c529571460ff388950799e7","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c529571460ff388950799e7: start","job_status":"start","queue_duration_s":2.680684,"scheduling_latency_s":2.68073}1434gitlab # [ 166.347837] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c529571460ff388950799e7","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c529571460ff388950799e7: done: 0.028293 sec","job_status":"done","queue_duration_s":2.680684,"scheduling_latency_s":2.68073,"redis_calls":13,"redis_duration_s":0.0038729999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001329,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002544,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028293,"completed_at":"2026-09-09T10:34:15.483Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 166.408067] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c26800d869e819df3d2324f1","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c26800d869e819df3d2324f1: start","job_status":"start","queue_duration_s":2.711927,"scheduling_latency_s":2.711971}1436gitlab # [ 166.430281] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c26800d869e819df3d2324f1","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c26800d869e819df3d2324f1: done: 0.026822 sec","job_status":"done","queue_duration_s":2.711927,"scheduling_latency_s":2.711971,"redis_calls":13,"redis_duration_s":0.003741,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001242,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002499,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026822,"completed_at":"2026-09-09T10:34:15.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 166.519300] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f0fd1d2ecfef3391f0de33e","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f0fd1d2ecfef3391f0de33e: start","job_status":"start","queue_duration_s":2.741153,"scheduling_latency_s":2.741248}1438gitlab # [ 166.520606] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f0fd1d2ecfef3391f0de33e","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f0fd1d2ecfef3391f0de33e: done: 0.027374 sec","job_status":"done","queue_duration_s":2.741153,"scheduling_latency_s":2.741248,"redis_calls":13,"redis_duration_s":0.004216,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002269,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027374,"completed_at":"2026-09-09T10:34:15.543Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 166.624907] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e524490e78437c014ea2601e","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e524490e78437c014ea2601e: start","job_status":"start","queue_duration_s":2.77142,"scheduling_latency_s":2.771465}1440gitlab # [ 166.626209] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e524490e78437c014ea2601e","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e524490e78437c014ea2601e: done: 0.031194 sec","job_status":"done","queue_duration_s":2.77142,"scheduling_latency_s":2.771465,"redis_calls":13,"redis_duration_s":0.00401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001367,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002643,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031194,"completed_at":"2026-09-09T10:34:15.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 166.693694] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a28dfeda95772d70b36e7fc5","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a28dfeda95772d70b36e7fc5: start","job_status":"start","queue_duration_s":2.805484,"scheduling_latency_s":2.805529}1442gitlab # [ 166.697293] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a28dfeda95772d70b36e7fc5","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a28dfeda95772d70b36e7fc5: done: 0.029607 sec","job_status":"done","queue_duration_s":2.805484,"scheduling_latency_s":2.805529,"redis_calls":13,"redis_duration_s":0.004337,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001368,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029607,"completed_at":"2026-09-09T10:34:15.609Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 166.715292] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c293d7f1e5e58093425e9d0","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c293d7f1e5e58093425e9d0: start","job_status":"start","queue_duration_s":2.837672,"scheduling_latency_s":2.837714}1444gitlab # [ 166.791257] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c293d7f1e5e58093425e9d0","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c293d7f1e5e58093425e9d0: done: 0.030779 sec","job_status":"done","queue_duration_s":2.837672,"scheduling_latency_s":2.837714,"redis_calls":13,"redis_duration_s":0.003971,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001322,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002649,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030779,"completed_at":"2026-09-09T10:34:15.643Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 166.803518] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c3d349a23800cb5f8815381","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c3d349a23800cb5f8815381: start","job_status":"start","queue_duration_s":2.871208,"scheduling_latency_s":2.871253}1446gitlab # [ 166.828589] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c3d349a23800cb5f8815381","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c3d349a23800cb5f8815381: done: 0.030033 sec","job_status":"done","queue_duration_s":2.871208,"scheduling_latency_s":2.871253,"redis_calls":13,"redis_duration_s":0.003932,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001234,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002698,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030033,"completed_at":"2026-09-09T10:34:15.675Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 166.996451] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"945abe54686718bb1688390a","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-945abe54686718bb1688390a: start","job_status":"start","queue_duration_s":2.90388,"scheduling_latency_s":2.903924}1448gitlab # [ 166.999340] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"945abe54686718bb1688390a","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-945abe54686718bb1688390a: done: 0.026038 sec","job_status":"done","queue_duration_s":2.90388,"scheduling_latency_s":2.903924,"redis_calls":13,"redis_duration_s":0.0033049999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001205,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026038,"completed_at":"2026-09-09T10:34:15.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 167.015578] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5287ea7857401c1eee317564","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5287ea7857401c1eee317564: start","job_status":"start","queue_duration_s":2.932829,"scheduling_latency_s":2.932871}1450gitlab # [ 167.084263] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5287ea7857401c1eee317564","created_at":"2026-09-09T10:34:12.524Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-a6128320c8bf4bf5","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"99cc073f48968a91fdc57b1bee7286b8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:12.774Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5287ea7857401c1eee317564: done: 0.028184 sec","job_status":"done","queue_duration_s":2.932829,"scheduling_latency_s":2.932871,"redis_calls":13,"redis_duration_s":0.003711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001323,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002388,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028184,"completed_at":"2026-09-09T10:34:15.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 167.176396] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.738Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"13ea3d02a7098205172abb5b","created_at":"2026-09-09T10:34:13.696Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-1ed09dcd317a48af","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f4befb8465cf32eada93f874ac7b23b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:13.738Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-13ea3d02a7098205172abb5b: start","job_status":"start","queue_duration_s":2.000194,"scheduling_latency_s":2.000236}1452gitlab # [ 167.176681] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.769Z","message":"No existing merge request to be cleaned up."}1453gitlab # [ 167.176895] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.795Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"13ea3d02a7098205172abb5b","created_at":"2026-09-09T10:34:13.696Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-1ed09dcd317a48af","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f4befb8465cf32eada93f874ac7b23b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:13.738Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-13ea3d02a7098205172abb5b: done: 0.057093 sec","job_status":"done","queue_duration_s":2.000194,"scheduling_latency_s":2.000236,"redis_calls":13,"redis_duration_s":0.004655,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000693,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000773562,"duration_s":0.057093,"completed_at":"2026-09-09T10:34:15.795Z","load_balancing_strategy":"primary","db_duration_s":0.006988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 167.263058] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.798Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5cf8a2215c8e69f7bfc1fe8a","created_at":"2026-09-09T10:34:13.696Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-1ed09dcd317a48af","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f4befb8465cf32eada93f874ac7b23b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:13.738Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5cf8a2215c8e69f7bfc1fe8a: start","job_status":"start","queue_duration_s":2.060123,"scheduling_latency_s":2.060166}1455gitlab # [ 167.264089] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.818Z","message":"No existing merge request to be cleaned up."}1456gitlab # [ 167.265286] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.835Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5cf8a2215c8e69f7bfc1fe8a","created_at":"2026-09-09T10:34:13.696Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-1ed09dcd317a48af","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f4befb8465cf32eada93f874ac7b23b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:13.738Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5cf8a2215c8e69f7bfc1fe8a: done: 0.036543 sec","job_status":"done","queue_duration_s":2.060123,"scheduling_latency_s":2.060166,"redis_calls":10,"redis_duration_s":0.00349,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001982,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036543,"completed_at":"2026-09-09T10:34:15.834Z","load_balancing_strategy":"primary","db_duration_s":0.003177,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 167.337367] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.837Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c3138fcadecaa492ec380ec9","created_at":"2026-09-09T10:34:13.696Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-1ed09dcd317a48af","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f4befb8465cf32eada93f874ac7b23b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:13.738Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c3138fcadecaa492ec380ec9: start","job_status":"start","queue_duration_s":2.09913,"scheduling_latency_s":2.099172}1458gitlab # [ 167.338803] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.857Z","message":"No existing merge request to be cleaned up."}1459gitlab # [ 167.340037] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.875Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c3138fcadecaa492ec380ec9","created_at":"2026-09-09T10:34:13.696Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-1ed09dcd317a48af","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f4befb8465cf32eada93f874ac7b23b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:13.738Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c3138fcadecaa492ec380ec9: done: 0.038075 sec","job_status":"done","queue_duration_s":2.09913,"scheduling_latency_s":2.099172,"redis_calls":10,"redis_duration_s":0.0034609999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00156,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001901,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038075,"completed_at":"2026-09-09T10:34:15.875Z","load_balancing_strategy":"primary","db_duration_s":0.003259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 167.364975] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.878Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ed060bd64ce4bcd0a0c5ca3b","created_at":"2026-09-09T10:34:13.696Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-1ed09dcd317a48af","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f4befb8465cf32eada93f874ac7b23b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:13.738Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ed060bd64ce4bcd0a0c5ca3b: start","job_status":"start","queue_duration_s":2.140521,"scheduling_latency_s":2.140564}1461gitlab # [ 167.442690] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.901Z","message":"No existing merge request to be cleaned up."}1462gitlab # [ 167.443996] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:34:15.918Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ed060bd64ce4bcd0a0c5ca3b","created_at":"2026-09-09T10:34:13.696Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-1ed09dcd317a48af","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"f4befb8465cf32eada93f874ac7b23b8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:34:13.738Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ed060bd64ce4bcd0a0c5ca3b: done: 0.040094 sec","job_status":"done","queue_duration_s":2.140521,"scheduling_latency_s":2.140564,"redis_calls":10,"redis_duration_s":0.00381,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002285,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040094,"completed_at":"2026-09-09T10:34:15.918Z","load_balancing_strategy":"primary","db_duration_s":0.003388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 167.656989] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 3225099174 wd_nsec: 32250978281464gitlab # [ 214.441346] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:05.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9c4846040c33cd0687ba2f0a","created_at":"2026-09-09T10:35:05.641Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"800a5e8b8973dd6129bc047109f1a34b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:05.688Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9c4846040c33cd0687ba2f0a: start","job_status":"start","queue_duration_s":0.003743,"scheduling_latency_s":0.003796}1465gitlab # [ 214.682146] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:05.935Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9c4846040c33cd0687ba2f0a","created_at":"2026-09-09T10:35:05.641Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"800a5e8b8973dd6129bc047109f1a34b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:05.688Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9c4846040c33cd0687ba2f0a: done: 0.243033 sec","job_status":"done","queue_duration_s":0.003743,"scheduling_latency_s":0.003796,"redis_calls":15,"redis_duration_s":0.07775,"redis_read_bytes":1029,"redis_write_bytes":1339,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.041128,"redis_feature_flag_read_bytes":1024,"redis_feature_flag_write_bytes":513,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009966,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.026656,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.073,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.073,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.243033,"completed_at":"2026-09-09T10:35:05.934Z","load_balancing_strategy":"primary","db_duration_s":0.092317,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 214.796874] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:06.050Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2a62e982d4e014371d073f38","created_at":"2026-09-09T10:35:05.753Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f8738cd83535c19c991ca8b18723d8d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:05.768Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2a62e982d4e014371d073f38: start","job_status":"start","queue_duration_s":0.2818,"scheduling_latency_s":0.281915}1467gitlab # [ 214.962725] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:06.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2a62e982d4e014371d073f38","created_at":"2026-09-09T10:35:05.753Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f8738cd83535c19c991ca8b18723d8d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:05.768Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2a62e982d4e014371d073f38: done: 0.165773 sec","job_status":"done","queue_duration_s":0.2818,"scheduling_latency_s":0.281915,"redis_calls":9,"redis_duration_s":0.09232599999999999,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01182,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.080506,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001345702,"exclusive_lock_hold_duration_s":0.00755096,"duration_s":0.165773,"completed_at":"2026-09-09T10:35:06.215Z","load_balancing_strategy":"primary","db_duration_s":0.002465,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 215.056666] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:06.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6d76dad656f3445e86be358e","created_at":"2026-09-09T10:35:05.807Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb9b60940e7a9ed1d877d5ece30dde96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:35:05.820Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6d76dad656f3445e86be358e: start","job_status":"start","queue_duration_s":0.489641,"scheduling_latency_s":0.489689}1469gitlab # [ 215.087237] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:06.338Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1470gitlab # [ 215.128979] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:06.381Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6d76dad656f3445e86be358e","created_at":"2026-09-09T10:35:05.807Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb9b60940e7a9ed1d877d5ece30dde96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:35:05.820Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6d76dad656f3445e86be358e: done: 0.072237 sec","job_status":"done","queue_duration_s":0.489641,"scheduling_latency_s":0.489689,"redis_calls":7,"redis_duration_s":0.015101,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001932,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.072237,"completed_at":"2026-09-09T10:35:06.381Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 215.220891] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:06.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"415df1c14693e4a28eea4891","created_at":"2026-09-09T10:35:05.845Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc1de8d012e8658674efc2ee27e78f3f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:05.855Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-415df1c14693e4a28eea4891: start","job_status":"start","queue_duration_s":0.614319,"scheduling_latency_s":0.614533}1472gitlab # [ 215.357474] setup-gitlab-start[2258]: W, [2026-09-09T10:35:06.610537 #2258] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1473gitlab # [ 215.539728] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:06.791Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"415df1c14693e4a28eea4891","created_at":"2026-09-09T10:35:05.845Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc1de8d012e8658674efc2ee27e78f3f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:05.855Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-415df1c14693e4a28eea4891: done: 0.321424 sec","job_status":"done","queue_duration_s":0.614319,"scheduling_latency_s":0.614533,"redis_calls":9,"redis_duration_s":0.060277000000000004,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.014925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.045352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.077,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.077,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.003774222,"exclusive_lock_hold_duration_s":0.065826522,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.321424,"completed_at":"2026-09-09T10:35:06.791Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.099112,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 215.671577] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:06.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1e8a7ad86fb99a4f1c9785b5","created_at":"2026-09-09T10:35:05.875Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9265049c009bf65973551f71a900c676","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:05.881Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1e8a7ad86fb99a4f1c9785b5: start","job_status":"start","queue_duration_s":1.039701,"scheduling_latency_s":1.039763}1475gitlab # [ 215.783177] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:07.034Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1476gitlab # [ 215.843394] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:07.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1e8a7ad86fb99a4f1c9785b5","created_at":"2026-09-09T10:35:05.875Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9265049c009bf65973551f71a900c676","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:05.881Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1e8a7ad86fb99a4f1c9785b5: done: 0.17127 sec","job_status":"done","queue_duration_s":1.039701,"scheduling_latency_s":1.039763,"redis_calls":7,"redis_duration_s":0.02206,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012947,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009113,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.17127,"completed_at":"2026-09-09T10:35:07.092Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 215.944386] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:07.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"29f042e4b21cce26a318a0e7","created_at":"2026-09-09T10:35:05.905Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"234fd6ec724e38e7a815fe526271dc68","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:35:05.917Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-29f042e4b21cce26a318a0e7: start","job_status":"start","queue_duration_s":1.279951,"scheduling_latency_s":1.280007}1478gitlab # [ 216.056148] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:07.308Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1479gitlab # [ 216.085401] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:07.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"29f042e4b21cce26a318a0e7","created_at":"2026-09-09T10:35:05.905Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"234fd6ec724e38e7a815fe526271dc68","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:35:05.917Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-29f042e4b21cce26a318a0e7: done: 0.139714 sec","job_status":"done","queue_duration_s":1.279951,"scheduling_latency_s":1.280007,"redis_calls":7,"redis_duration_s":0.044577,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.042155,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002422,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.139714,"completed_at":"2026-09-09T10:35:07.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 216.185548] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:07.346Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"90ef5b2ffdc5c905e9012dff","created_at":"2026-09-09T10:35:05.936Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5f73a51ec0108e81f32d8d9cd78bf98","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.034Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-90ef5b2ffdc5c905e9012dff: start","job_status":"start","queue_duration_s":1.311213,"scheduling_latency_s":1.311276}1481gitlab # [ 217.002384] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:08.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"90ef5b2ffdc5c905e9012dff","created_at":"2026-09-09T10:35:05.936Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5f73a51ec0108e81f32d8d9cd78bf98","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.034Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-90ef5b2ffdc5c905e9012dff: done: 0.908668 sec","job_status":"done","queue_duration_s":1.311213,"scheduling_latency_s":1.311276,"redis_calls":9,"redis_duration_s":0.010245,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005538,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004707,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.132,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.132,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.574134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002087975,"exclusive_lock_hold_duration_s":0.817524295,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.908668,"completed_at":"2026-09-09T10:35:08.254Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.272137,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 217.005779] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:08.259Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"569be804a0f4eb28120887d3","created_at":"2026-09-09T10:35:06.045Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e88639c5fe7c30d5398d1aa20ff700be","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.052Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-569be804a0f4eb28120887d3: start","job_status":"start","queue_duration_s":2.206182,"scheduling_latency_s":2.206234}1483gitlab # [ 217.970457] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"569be804a0f4eb28120887d3","created_at":"2026-09-09T10:35:06.045Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e88639c5fe7c30d5398d1aa20ff700be","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.052Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-569be804a0f4eb28120887d3: done: 0.964624 sec","job_status":"done","queue_duration_s":2.206182,"scheduling_latency_s":2.206234,"redis_calls":562,"redis_duration_s":0.401034,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.3973,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.637108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.964624,"completed_at":"2026-09-09T10:35:09.223Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 218.035389] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.226Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"124cc6db3a3de4349f6561c1","created_at":"2026-09-09T10:35:06.173Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"986326c103730802824cb04e274de6c2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.201Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-124cc6db3a3de4349f6561c1: start","job_status":"start","queue_duration_s":3.025294,"scheduling_latency_s":3.025367}1485gitlab # [ 218.058207] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"124cc6db3a3de4349f6561c1","created_at":"2026-09-09T10:35:06.173Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"986326c103730802824cb04e274de6c2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.201Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-124cc6db3a3de4349f6561c1: done: 0.052506 sec","job_status":"done","queue_duration_s":3.025294,"scheduling_latency_s":3.025367,"redis_calls":11,"redis_duration_s":0.011099999999999999,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00484,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004835,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000603,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000822,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000646451,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.052506,"completed_at":"2026-09-09T10:35:09.278Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 218.128452] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.282Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b910e9b4f103ad77d456d1cf","created_at":"2026-09-09T10:35:06.314Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17f78fd4c472c11c1f712c6cc3c915ba","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.321Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b910e9b4f103ad77d456d1cf: start","job_status":"start","queue_duration_s":2.961097,"scheduling_latency_s":2.96115}1487gitlab # [ 218.151651] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b910e9b4f103ad77d456d1cf","created_at":"2026-09-09T10:35:06.314Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17f78fd4c472c11c1f712c6cc3c915ba","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.321Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b910e9b4f103ad77d456d1cf: done: 0.053493 sec","job_status":"done","queue_duration_s":2.961097,"scheduling_latency_s":2.96115,"redis_calls":8,"redis_duration_s":0.010584,"redis_read_bytes":133,"redis_write_bytes":791,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001605,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002347,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053493,"completed_at":"2026-09-09T10:35:09.335Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 218.217742] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.340Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"44209dbece925e01b0289c62","created_at":"2026-09-09T10:35:06.363Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52ebd325987b777aa548609f87b9aac2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.377Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-44209dbece925e01b0289c62: start","job_status":"start","queue_duration_s":2.962747,"scheduling_latency_s":2.962803}1489gitlab # [ 218.241965] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.391Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"44209dbece925e01b0289c62","created_at":"2026-09-09T10:35:06.363Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52ebd325987b777aa548609f87b9aac2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.377Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-44209dbece925e01b0289c62: done: 0.051326 sec","job_status":"done","queue_duration_s":2.962747,"scheduling_latency_s":2.962803,"redis_calls":9,"redis_duration_s":0.012851,"redis_read_bytes":261,"redis_write_bytes":1040,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001885,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":209,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051326,"completed_at":"2026-09-09T10:35:09.391Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 218.289137] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.398Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"984f3da95bed857fbb8e7d6b","created_at":"2026-09-09T10:35:06.468Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8acafe438ec3e0b7d221de752b5e312d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.527Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-984f3da95bed857fbb8e7d6b: start","job_status":"start","queue_duration_s":2.871323,"scheduling_latency_s":2.871381}1491gitlab # [ 218.539938] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"984f3da95bed857fbb8e7d6b","created_at":"2026-09-09T10:35:06.468Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8acafe438ec3e0b7d221de752b5e312d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.527Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-984f3da95bed857fbb8e7d6b: done: 0.394085 sec","job_status":"done","queue_duration_s":2.871323,"scheduling_latency_s":2.871381,"redis_calls":12,"redis_duration_s":0.013887,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003947,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.295266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002858184,"exclusive_lock_hold_duration_s":0.334043572,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.394085,"completed_at":"2026-09-09T10:35:09.792Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04769,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1492gitlab # [ 218.542850] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"020363c113bc1a0ff55a19a1","created_at":"2026-09-09T10:35:06.569Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3186326640051b843e3d5ca5c32190ef","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.587Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-020363c113bc1a0ff55a19a1: start","job_status":"start","queue_duration_s":3.208411,"scheduling_latency_s":3.20846}1493gitlab # [ 218.647451] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"020363c113bc1a0ff55a19a1","created_at":"2026-09-09T10:35:06.569Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3186326640051b843e3d5ca5c32190ef","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.587Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-020363c113bc1a0ff55a19a1: done: 0.063653 sec","job_status":"done","queue_duration_s":3.208411,"scheduling_latency_s":3.20846,"redis_calls":11,"redis_duration_s":0.013180999999999998,"redis_read_bytes":136,"redis_write_bytes":1366,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00049,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":127,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007935,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004756,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011464586,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.063653,"completed_at":"2026-09-09T10:35:09.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004032,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1494gitlab # [ 218.733843] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"348417e63bcb3b63a7c2c70b","created_at":"2026-09-09T10:35:06.597Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26f0623de6ac0ba8fcb7ec93ea87fe31","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.605Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-348417e63bcb3b63a7c2c70b: start","job_status":"start","queue_duration_s":3.262132,"scheduling_latency_s":3.262191}1495gitlab # [ 218.761872] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.929Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"348417e63bcb3b63a7c2c70b","created_at":"2026-09-09T10:35:06.597Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26f0623de6ac0ba8fcb7ec93ea87fe31","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.605Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-348417e63bcb3b63a7c2c70b: done: 0.062175 sec","job_status":"done","queue_duration_s":3.262132,"scheduling_latency_s":3.262191,"redis_calls":10,"redis_duration_s":0.013066,"redis_read_bytes":135,"redis_write_bytes":1211,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001897,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":124,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.003135873,"exclusive_lock_hold_duration_s":0.008476217,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.062175,"completed_at":"2026-09-09T10:35:09.929Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 218.842963] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:09.935Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"c0fb13a52111091165b65f2d","created_at":"2026-09-09T10:35:06.634Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.641Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-c0fb13a52111091165b65f2d: start","job_status":"start","queue_duration_s":3.293431,"scheduling_latency_s":3.29349}1497gitlab # [ 218.970980] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.222Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"c0fb13a52111091165b65f2d","created_at":"2026-09-09T10:35:06.634Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.641Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-c0fb13a52111091165b65f2d: done: 0.287318 sec","job_status":"done","queue_duration_s":3.293431,"scheduling_latency_s":3.29349,"redis_calls":61,"redis_duration_s":0.07167,"redis_read_bytes":236,"redis_write_bytes":41233,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000529,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":124,"redis_queues_calls":2,"redis_queues_duration_s":0.003861,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.063689,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003591,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.197711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.287318,"completed_at":"2026-09-09T10:35:10.222Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 218.980836] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.231Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d255362b0b57aa27926e53bf","created_at":"2026-09-09T10:35:06.661Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03586acb1102e8faaa393ec9d23b7cac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:35:06.672Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d255362b0b57aa27926e53bf: start","job_status":"start","queue_duration_s":3.558958,"scheduling_latency_s":3.559017}1499gitlab # [ 219.072312] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.308Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d255362b0b57aa27926e53bf","created_at":"2026-09-09T10:35:06.661Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03586acb1102e8faaa393ec9d23b7cac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:35:06.672Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d255362b0b57aa27926e53bf: done: 0.076767 sec","job_status":"done","queue_duration_s":3.558958,"scheduling_latency_s":3.559017,"redis_calls":8,"redis_duration_s":0.010591,"redis_read_bytes":133,"redis_write_bytes":863,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001922,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":122,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005886,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002783,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076767,"completed_at":"2026-09-09T10:35:10.308Z","load_balancing_strategy":"primary","db_duration_s":0.004008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 219.080407] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.316Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"ddb9caded6707246525b40f1","created_at":"2026-09-09T10:35:06.684Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d3783feb07f0905da1c547402b580aa","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.700Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-ddb9caded6707246525b40f1: start","job_status":"start","queue_duration_s":3.615817,"scheduling_latency_s":3.615873}1501gitlab # [ 219.157977] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.409Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"ddb9caded6707246525b40f1","created_at":"2026-09-09T10:35:06.684Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d3783feb07f0905da1c547402b580aa","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.700Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-ddb9caded6707246525b40f1: done: 0.093712 sec","job_status":"done","queue_duration_s":3.615817,"scheduling_latency_s":3.615873,"redis_calls":10,"redis_duration_s":0.015896,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001694,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008192,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00601,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002362032,"duration_s":0.093712,"completed_at":"2026-09-09T10:35:10.409Z","load_balancing_strategy":"primary","db_duration_s":0.011411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 219.281741] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.419Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"03214761a6933018280d0b2e","created_at":"2026-09-09T10:35:06.762Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c5677f91b23d64003187deab3a49c71","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.776Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-03214761a6933018280d0b2e: start","job_status":"start","queue_duration_s":3.642443,"scheduling_latency_s":3.642501}1503gitlab # [ 219.284958] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.493Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"03214761a6933018280d0b2e","created_at":"2026-09-09T10:35:06.762Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c5677f91b23d64003187deab3a49c71","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.776Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-03214761a6933018280d0b2e: done: 0.07507 sec","job_status":"done","queue_duration_s":3.642443,"scheduling_latency_s":3.642501,"redis_calls":8,"redis_duration_s":0.012612,"redis_read_bytes":133,"redis_write_bytes":827,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001777,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":116,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007465,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00337,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.07507,"completed_at":"2026-09-09T10:35:10.493Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006835,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 219.362076] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.501Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"791a709ed038e4ee701a9e14","created_at":"2026-09-09T10:35:06.889Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5d0595b97f059b70e93fd7511181bd7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.908Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-791a709ed038e4ee701a9e14: start","job_status":"start","queue_duration_s":3.592476,"scheduling_latency_s":3.592827}1505gitlab # [ 219.362351] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.529Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1506gitlab # [ 219.362511] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.552Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"791a709ed038e4ee701a9e14","created_at":"2026-09-09T10:35:06.889Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5d0595b97f059b70e93fd7511181bd7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:06.908Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-791a709ed038e4ee701a9e14: done: 0.051343 sec","job_status":"done","queue_duration_s":3.592476,"scheduling_latency_s":3.592827,"redis_calls":8,"redis_duration_s":0.010681,"redis_read_bytes":133,"redis_write_bytes":900,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001053,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":129,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004208,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051343,"completed_at":"2026-09-09T10:35:10.552Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 219.462139] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.714Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d61f3f0846a831f582cac9a2","created_at":"2026-09-09T10:35:06.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"610787d377526ad810e15509a0a68a99","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:07.000Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d61f3f0846a831f582cac9a2: start","job_status":"start","queue_duration_s":3.713873,"scheduling_latency_s":3.713931}1508gitlab # [ 219.483142] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.735Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1509gitlab # [ 219.502749] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.755Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d61f3f0846a831f582cac9a2","created_at":"2026-09-09T10:35:06.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"610787d377526ad810e15509a0a68a99","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:07.000Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d61f3f0846a831f582cac9a2: done: 0.041408 sec","job_status":"done","queue_duration_s":3.713873,"scheduling_latency_s":3.713931,"redis_calls":8,"redis_duration_s":0.007498,"redis_read_bytes":133,"redis_write_bytes":958,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000776,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":137,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00577,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041408,"completed_at":"2026-09-09T10:35:10.755Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 219.510584] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.762Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f4fb4a0a35ad1ef47aa3a257","created_at":"2026-09-09T10:35:07.065Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f74edb76d4277f34d4f30899169a675","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:07.083Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f4fb4a0a35ad1ef47aa3a257: start","job_status":"start","queue_duration_s":3.678878,"scheduling_latency_s":3.678933}1511gitlab # [ 219.536918] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.789Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1512gitlab # [ 219.547232] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.800Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f4fb4a0a35ad1ef47aa3a257","created_at":"2026-09-09T10:35:07.065Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f74edb76d4277f34d4f30899169a675","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:07.083Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f4fb4a0a35ad1ef47aa3a257: done: 0.038465 sec","job_status":"done","queue_duration_s":3.678878,"scheduling_latency_s":3.678933,"redis_calls":8,"redis_duration_s":0.009429,"redis_read_bytes":133,"redis_write_bytes":964,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.004497,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":138,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038465,"completed_at":"2026-09-09T10:35:10.800Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 219.636224] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"41631e6f2e70bc86ed4df2d5","created_at":"2026-09-09T10:35:07.134Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"574be0f6eb221a3041cc57ff46babfc6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:07.149Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-41631e6f2e70bc86ed4df2d5: start","job_status":"start","queue_duration_s":3.658802,"scheduling_latency_s":3.65889}1514gitlab # [ 219.637358] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"41631e6f2e70bc86ed4df2d5","created_at":"2026-09-09T10:35:07.134Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"574be0f6eb221a3041cc57ff46babfc6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:07.149Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-41631e6f2e70bc86ed4df2d5: done: 0.077144 sec","job_status":"done","queue_duration_s":3.658802,"scheduling_latency_s":3.65889,"redis_calls":10,"redis_duration_s":0.006987999999999999,"redis_read_bytes":135,"redis_write_bytes":1294,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001108,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":132,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002084,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001264127,"exclusive_lock_hold_duration_s":0.039169224,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.077144,"completed_at":"2026-09-09T10:35:10.884Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 219.716670] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e37ee5dc89136b335ae650eb","created_at":"2026-09-09T10:35:07.159Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9164390a8ed1e690c6efe7869665068b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:07.164Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e37ee5dc89136b335ae650eb: start","job_status":"start","queue_duration_s":3.723583,"scheduling_latency_s":3.723628}1516gitlab # [ 219.723992] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.956Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e37ee5dc89136b335ae650eb","created_at":"2026-09-09T10:35:07.159Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9164390a8ed1e690c6efe7869665068b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:07.164Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e37ee5dc89136b335ae650eb: done: 0.06777 sec","job_status":"done","queue_duration_s":3.723583,"scheduling_latency_s":3.723628,"redis_calls":15,"redis_duration_s":0.014409,"redis_read_bytes":144,"redis_write_bytes":4147,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000369,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":117,"redis_queues_calls":2,"redis_queues_duration_s":0.000658,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.012072,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00131,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.06777,"completed_at":"2026-09-09T10:35:10.955Z","load_balancing_strategy":"primary","db_duration_s":0.001941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 219.806790] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:10.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"cb2d6b7e233e42db8d75b92f","created_at":"2026-09-09T10:35:07.196Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c4534a9e305f23806f0660ef26c07f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:07.238Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-cb2d6b7e233e42db8d75b92f: start","job_status":"start","queue_duration_s":3.724838,"scheduling_latency_s":3.724893}1518gitlab # [ 219.808906] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"cb2d6b7e233e42db8d75b92f","created_at":"2026-09-09T10:35:07.196Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c4534a9e305f23806f0660ef26c07f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:07.238Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-cb2d6b7e233e42db8d75b92f: done: 0.043162 sec","job_status":"done","queue_duration_s":3.724838,"scheduling_latency_s":3.724893,"redis_calls":8,"redis_duration_s":0.011741999999999999,"redis_read_bytes":133,"redis_write_bytes":906,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.002946,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":130,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004476,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043162,"completed_at":"2026-09-09T10:35:11.006Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 219.932252] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49e538bda3fbc320e436a4f8","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49e538bda3fbc320e436a4f8: start","job_status":"start","queue_duration_s":0.809684,"scheduling_latency_s":0.809736}1520gitlab # [ 219.933376] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49e538bda3fbc320e436a4f8","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49e538bda3fbc320e436a4f8: done: 0.047688 sec","job_status":"done","queue_duration_s":0.809684,"scheduling_latency_s":0.809736,"redis_calls":13,"redis_duration_s":0.009327,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007344,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.047688,"completed_at":"2026-09-09T10:35:11.057Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 219.953434] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f5528fc91f20171cc0c658e","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f5528fc91f20171cc0c658e: start","job_status":"start","queue_duration_s":0.865642,"scheduling_latency_s":0.865702}1522gitlab # [ 219.996482] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f5528fc91f20171cc0c658e","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f5528fc91f20171cc0c658e: done: 0.067771 sec","job_status":"done","queue_duration_s":0.865642,"scheduling_latency_s":0.865702,"redis_calls":13,"redis_duration_s":0.022046999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.010395,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011652,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.067771,"completed_at":"2026-09-09T10:35:11.133Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 220.086534] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dff44e22287a8081d0d1ac5","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dff44e22287a8081d0d1ac5: start","job_status":"start","queue_duration_s":0.940119,"scheduling_latency_s":0.940175}1524gitlab # [ 220.103385] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dff44e22287a8081d0d1ac5","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dff44e22287a8081d0d1ac5: done: 0.040756 sec","job_status":"done","queue_duration_s":0.940119,"scheduling_latency_s":0.940175,"redis_calls":13,"redis_duration_s":0.004875,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001648,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003227,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040756,"completed_at":"2026-09-09T10:35:11.180Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 220.165288] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf3d7cd568badebe4ac5fe56","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf3d7cd568badebe4ac5fe56: start","job_status":"start","queue_duration_s":0.984138,"scheduling_latency_s":0.984186}1526gitlab # [ 220.238488] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf3d7cd568badebe4ac5fe56","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf3d7cd568badebe4ac5fe56: done: 0.086776 sec","job_status":"done","queue_duration_s":0.984138,"scheduling_latency_s":0.984186,"redis_calls":13,"redis_duration_s":0.005696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001832,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.086776,"completed_at":"2026-09-09T10:35:11.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 220.240288] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a872669e1ac6e759ca5302a9","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a872669e1ac6e759ca5302a9: start","job_status":"start","queue_duration_s":1.07431,"scheduling_latency_s":1.07436}1528gitlab # [ 220.323384] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a872669e1ac6e759ca5302a9","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a872669e1ac6e759ca5302a9: done: 0.049062 sec","job_status":"done","queue_duration_s":1.07431,"scheduling_latency_s":1.07436,"redis_calls":13,"redis_duration_s":0.014475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007162,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007313,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.049062,"completed_at":"2026-09-09T10:35:11.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 220.331200] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23b0ced4fff9ef20be264ee6","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23b0ced4fff9ef20be264ee6: start","job_status":"start","queue_duration_s":1.131177,"scheduling_latency_s":1.131242}1530gitlab # [ 220.420108] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23b0ced4fff9ef20be264ee6","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23b0ced4fff9ef20be264ee6: done: 0.074475 sec","job_status":"done","queue_duration_s":1.131177,"scheduling_latency_s":1.131242,"redis_calls":13,"redis_duration_s":0.005790999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001748,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.074475,"completed_at":"2026-09-09T10:35:11.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 220.422140] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fe5c264f95e09d08df969c8","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fe5c264f95e09d08df969c8: start","job_status":"start","queue_duration_s":1.207998,"scheduling_latency_s":1.208043}1532gitlab # [ 220.438296] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fe5c264f95e09d08df969c8","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fe5c264f95e09d08df969c8: done: 0.029295 sec","job_status":"done","queue_duration_s":1.207998,"scheduling_latency_s":1.208043,"redis_calls":13,"redis_duration_s":0.004219,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029295,"completed_at":"2026-09-09T10:35:11.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 220.546535] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fa8df4f35fe78f5d8e5804c","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fa8df4f35fe78f5d8e5804c: start","job_status":"start","queue_duration_s":1.242391,"scheduling_latency_s":1.24246}1534gitlab # [ 220.552129] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fa8df4f35fe78f5d8e5804c","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fa8df4f35fe78f5d8e5804c: done: 0.04778 sec","job_status":"done","queue_duration_s":1.242391,"scheduling_latency_s":1.24246,"redis_calls":13,"redis_duration_s":0.013818,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005189,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008629,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04778,"completed_at":"2026-09-09T10:35:11.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 220.633914] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf58d25fc82c1107cb3e6211","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf58d25fc82c1107cb3e6211: start","job_status":"start","queue_duration_s":1.302952,"scheduling_latency_s":1.303005}1536gitlab # [ 220.635097] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf58d25fc82c1107cb3e6211","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf58d25fc82c1107cb3e6211: done: 0.05614 sec","job_status":"done","queue_duration_s":1.302952,"scheduling_latency_s":1.303005,"redis_calls":13,"redis_duration_s":0.014126,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004446,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.05614,"completed_at":"2026-09-09T10:35:11.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 220.712135] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"496db93ca42ab80358ccc3d3","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-496db93ca42ab80358ccc3d3: start","job_status":"start","queue_duration_s":1.364008,"scheduling_latency_s":1.364061}1538gitlab # [ 220.713472] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"496db93ca42ab80358ccc3d3","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-496db93ca42ab80358ccc3d3: done: 0.054425 sec","job_status":"done","queue_duration_s":1.364008,"scheduling_latency_s":1.364061,"redis_calls":13,"redis_duration_s":0.009866,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001718,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008148,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.054425,"completed_at":"2026-09-09T10:35:11.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 220.763534] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f39cfcb0f9b6f5bd7e125595","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f39cfcb0f9b6f5bd7e125595: start","job_status":"start","queue_duration_s":1.423043,"scheduling_latency_s":1.423099}1540gitlab # [ 220.861653] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f39cfcb0f9b6f5bd7e125595","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f39cfcb0f9b6f5bd7e125595: done: 0.078298 sec","job_status":"done","queue_duration_s":1.423043,"scheduling_latency_s":1.423099,"redis_calls":13,"redis_duration_s":0.029619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.018231,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011388,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.078298,"completed_at":"2026-09-09T10:35:11.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 220.863425] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"091dfd5be3f2aa55c7d596a9","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-091dfd5be3f2aa55c7d596a9: start","job_status":"start","queue_duration_s":1.509145,"scheduling_latency_s":1.509195}1542gitlab # [ 220.951241] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"091dfd5be3f2aa55c7d596a9","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-091dfd5be3f2aa55c7d596a9: done: 0.029119 sec","job_status":"done","queue_duration_s":1.509145,"scheduling_latency_s":1.509195,"redis_calls":13,"redis_duration_s":0.003922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00131,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002612,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029119,"completed_at":"2026-09-09T10:35:11.738Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 220.953051] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ce38958049c70b3148daf35","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ce38958049c70b3148daf35: start","job_status":"start","queue_duration_s":1.541117,"scheduling_latency_s":1.541165}1544gitlab # [ 220.963322] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ce38958049c70b3148daf35","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ce38958049c70b3148daf35: done: 0.092354 sec","job_status":"done","queue_duration_s":1.541117,"scheduling_latency_s":1.541165,"redis_calls":13,"redis_duration_s":0.051102999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.024779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.026324,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.092354,"completed_at":"2026-09-09T10:35:11.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 221.019586] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:11.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c657c2b6ed44715529bcc56","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c657c2b6ed44715529bcc56: start","job_status":"start","queue_duration_s":1.754352,"scheduling_latency_s":1.754423}1546gitlab # [ 221.028117] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c657c2b6ed44715529bcc56","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c657c2b6ed44715529bcc56: done: 0.253191 sec","job_status":"done","queue_duration_s":1.754352,"scheduling_latency_s":1.754423,"redis_calls":13,"redis_duration_s":0.005163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003459,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.253191,"completed_at":"2026-09-09T10:35:12.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 221.094474] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33dbcdf1aeb8271b42c98259","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33dbcdf1aeb8271b42c98259: start","job_status":"start","queue_duration_s":2.00992,"scheduling_latency_s":2.00996}1548gitlab # [ 221.095786] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33dbcdf1aeb8271b42c98259","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33dbcdf1aeb8271b42c98259: done: 0.038465 sec","job_status":"done","queue_duration_s":2.00992,"scheduling_latency_s":2.00996,"redis_calls":13,"redis_duration_s":0.005148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001661,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003487,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038465,"completed_at":"2026-09-09T10:35:12.248Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 221.163182] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"128b3531f5afb65a7ab2fe9b","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-128b3531f5afb65a7ab2fe9b: start","job_status":"start","queue_duration_s":2.053539,"scheduling_latency_s":2.053596}1550gitlab # [ 221.164451] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"128b3531f5afb65a7ab2fe9b","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-128b3531f5afb65a7ab2fe9b: done: 0.034551 sec","job_status":"done","queue_duration_s":2.053539,"scheduling_latency_s":2.053596,"redis_calls":13,"redis_duration_s":0.003918,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002463,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034551,"completed_at":"2026-09-09T10:35:12.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 221.249786] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d614186bb93c37c7274c4fe9","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d614186bb93c37c7274c4fe9: start","job_status":"start","queue_duration_s":2.090327,"scheduling_latency_s":2.090369}1552gitlab # [ 221.251313] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d614186bb93c37c7274c4fe9","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d614186bb93c37c7274c4fe9: done: 0.039361 sec","job_status":"done","queue_duration_s":2.090327,"scheduling_latency_s":2.090369,"redis_calls":13,"redis_duration_s":0.004909,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003292,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039361,"completed_at":"2026-09-09T10:35:12.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 221.353910] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"495ae6c38adf966d00ef8dd1","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-495ae6c38adf966d00ef8dd1: start","job_status":"start","queue_duration_s":2.133511,"scheduling_latency_s":2.133566}1554gitlab # [ 221.355180] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"495ae6c38adf966d00ef8dd1","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-495ae6c38adf966d00ef8dd1: done: 0.035214 sec","job_status":"done","queue_duration_s":2.133511,"scheduling_latency_s":2.133566,"redis_calls":13,"redis_duration_s":0.0038480000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002354,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035214,"completed_at":"2026-09-09T10:35:12.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 221.380888] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61bce0f39bd21b1f2debd064","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61bce0f39bd21b1f2debd064: start","job_status":"start","queue_duration_s":2.175135,"scheduling_latency_s":2.175188}1556gitlab # [ 221.402454] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61bce0f39bd21b1f2debd064","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61bce0f39bd21b1f2debd064: done: 0.045506 sec","job_status":"done","queue_duration_s":2.175135,"scheduling_latency_s":2.175188,"redis_calls":13,"redis_duration_s":0.004678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045506,"completed_at":"2026-09-09T10:35:12.420Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 221.487555] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e51a1610e342b1a729c0238","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e51a1610e342b1a729c0238: start","job_status":"start","queue_duration_s":2.222994,"scheduling_latency_s":2.223038}1558gitlab # [ 221.488770] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e51a1610e342b1a729c0238","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e51a1610e342b1a729c0238: done: 0.032045 sec","job_status":"done","queue_duration_s":2.222994,"scheduling_latency_s":2.223038,"redis_calls":13,"redis_duration_s":0.004044000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001458,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002586,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032045,"completed_at":"2026-09-09T10:35:12.455Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 221.550212] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26404fc0bace035a68dc3257","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26404fc0bace035a68dc3257: start","job_status":"start","queue_duration_s":2.258038,"scheduling_latency_s":2.258083}1560gitlab # [ 221.563281] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26404fc0bace035a68dc3257","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26404fc0bace035a68dc3257: done: 0.035678 sec","job_status":"done","queue_duration_s":2.258038,"scheduling_latency_s":2.258083,"redis_calls":13,"redis_duration_s":0.0043560000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035678,"completed_at":"2026-09-09T10:35:12.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 221.660553] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f60ed154f0f27d53cd32cd8","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f60ed154f0f27d53cd32cd8: start","job_status":"start","queue_duration_s":2.298001,"scheduling_latency_s":2.298052}1562gitlab # [ 221.661789] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f60ed154f0f27d53cd32cd8","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f60ed154f0f27d53cd32cd8: done: 0.028387 sec","job_status":"done","queue_duration_s":2.298001,"scheduling_latency_s":2.298052,"redis_calls":14,"redis_duration_s":0.003321,"redis_read_bytes":138,"redis_write_bytes":1216,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":59,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028387,"completed_at":"2026-09-09T10:35:12.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 221.749489] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21ac4bf2d65f8076b23e656f","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21ac4bf2d65f8076b23e656f: start","job_status":"start","queue_duration_s":2.328493,"scheduling_latency_s":2.328534}1564gitlab # [ 221.751401] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21ac4bf2d65f8076b23e656f","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21ac4bf2d65f8076b23e656f: done: 0.033446 sec","job_status":"done","queue_duration_s":2.328493,"scheduling_latency_s":2.328534,"redis_calls":15,"redis_duration_s":0.004357,"redis_read_bytes":266,"redis_write_bytes":1282,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000584,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":125,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001355,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002418,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033446,"completed_at":"2026-09-09T10:35:12.562Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 221.849889] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"765a6b5defd9d30b3cb01798","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-765a6b5defd9d30b3cb01798: start","job_status":"start","queue_duration_s":2.364778,"scheduling_latency_s":2.364863}1566gitlab # [ 221.851217] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"765a6b5defd9d30b3cb01798","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-765a6b5defd9d30b3cb01798: done: 0.037669 sec","job_status":"done","queue_duration_s":2.364778,"scheduling_latency_s":2.364863,"redis_calls":14,"redis_duration_s":0.0046,"redis_read_bytes":138,"redis_write_bytes":1269,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":112,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001303,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037669,"completed_at":"2026-09-09T10:35:12.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 221.930369] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab0ad5b0875d47579fbd9db4","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab0ad5b0875d47579fbd9db4: start","job_status":"start","queue_duration_s":2.405121,"scheduling_latency_s":2.405168}1568gitlab # [ 221.932727] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab0ad5b0875d47579fbd9db4","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab0ad5b0875d47579fbd9db4: done: 0.033783 sec","job_status":"done","queue_duration_s":2.405121,"scheduling_latency_s":2.405168,"redis_calls":13,"redis_duration_s":0.003343,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002216,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033783,"completed_at":"2026-09-09T10:35:12.639Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 222.011854] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"319ada8c9a7b8e48ff2f81ef","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-319ada8c9a7b8e48ff2f81ef: start","job_status":"start","queue_duration_s":2.441082,"scheduling_latency_s":2.441124}1570gitlab # [ 222.013213] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"319ada8c9a7b8e48ff2f81ef","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-319ada8c9a7b8e48ff2f81ef: done: 0.02541 sec","job_status":"done","queue_duration_s":2.441082,"scheduling_latency_s":2.441124,"redis_calls":13,"redis_duration_s":0.0029360000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001041,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02541,"completed_at":"2026-09-09T10:35:12.666Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 222.080665] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e03dee3b3356b417410407f4","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e03dee3b3356b417410407f4: start","job_status":"start","queue_duration_s":2.468942,"scheduling_latency_s":2.468988}1572gitlab # [ 222.082154] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e03dee3b3356b417410407f4","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e03dee3b3356b417410407f4: done: 0.033536 sec","job_status":"done","queue_duration_s":2.468942,"scheduling_latency_s":2.468988,"redis_calls":13,"redis_duration_s":0.0039040000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001302,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002602,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033536,"completed_at":"2026-09-09T10:35:12.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 222.113688] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d31ab76d8af8f5d6ebe1466","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d31ab76d8af8f5d6ebe1466: start","job_status":"start","queue_duration_s":2.506457,"scheduling_latency_s":2.506504}1574gitlab # [ 222.132699] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d31ab76d8af8f5d6ebe1466","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d31ab76d8af8f5d6ebe1466: done: 0.034155 sec","job_status":"done","queue_duration_s":2.506457,"scheduling_latency_s":2.506504,"redis_calls":13,"redis_duration_s":0.0054719999999999994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00249,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034155,"completed_at":"2026-09-09T10:35:12.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 222.214376] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffde81e31c2fcab57bb3561a","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffde81e31c2fcab57bb3561a: start","job_status":"start","queue_duration_s":2.542969,"scheduling_latency_s":2.543013}1576gitlab # [ 222.215565] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffde81e31c2fcab57bb3561a","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffde81e31c2fcab57bb3561a: done: 0.036211 sec","job_status":"done","queue_duration_s":2.542969,"scheduling_latency_s":2.543013,"redis_calls":13,"redis_duration_s":0.004317,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002736,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036211,"completed_at":"2026-09-09T10:35:12.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 222.299423] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e1385bc01f172ac7e46277e","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e1385bc01f172ac7e46277e: start","job_status":"start","queue_duration_s":2.582121,"scheduling_latency_s":2.58217}1578gitlab # [ 222.301501] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e1385bc01f172ac7e46277e","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e1385bc01f172ac7e46277e: done: 0.033303 sec","job_status":"done","queue_duration_s":2.582121,"scheduling_latency_s":2.58217,"redis_calls":13,"redis_duration_s":0.003801,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002416,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033303,"completed_at":"2026-09-09T10:35:12.815Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 222.398355] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83d31eb8af98312b9ffc1a8a","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83d31eb8af98312b9ffc1a8a: start","job_status":"start","queue_duration_s":2.617774,"scheduling_latency_s":2.617845}1580gitlab # [ 222.399356] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83d31eb8af98312b9ffc1a8a","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83d31eb8af98312b9ffc1a8a: done: 0.027435 sec","job_status":"done","queue_duration_s":2.617774,"scheduling_latency_s":2.617845,"redis_calls":13,"redis_duration_s":0.003281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00106,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027435,"completed_at":"2026-09-09T10:35:12.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 222.420234] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4dba0375f438844fc4818c8","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4dba0375f438844fc4818c8: start","job_status":"start","queue_duration_s":2.64858,"scheduling_latency_s":2.648635}1582gitlab # [ 222.504485] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4dba0375f438844fc4818c8","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4dba0375f438844fc4818c8: done: 0.036352 sec","job_status":"done","queue_duration_s":2.64858,"scheduling_latency_s":2.648635,"redis_calls":13,"redis_duration_s":0.004241,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001429,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002812,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036352,"completed_at":"2026-09-09T10:35:12.884Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 222.514518] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0170daa92bf3d3652d4e375f","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0170daa92bf3d3652d4e375f: start","job_status":"start","queue_duration_s":2.687887,"scheduling_latency_s":2.687936}1584gitlab # [ 222.587211] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0170daa92bf3d3652d4e375f","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0170daa92bf3d3652d4e375f: done: 0.033274 sec","job_status":"done","queue_duration_s":2.687887,"scheduling_latency_s":2.687936,"redis_calls":13,"redis_duration_s":0.004126,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002719,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033274,"completed_at":"2026-09-09T10:35:12.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 222.595242] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dac93631de6caec5e2fb8671","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dac93631de6caec5e2fb8671: start","job_status":"start","queue_duration_s":2.723138,"scheduling_latency_s":2.72318}1586gitlab # [ 222.619410] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dac93631de6caec5e2fb8671","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dac93631de6caec5e2fb8671: done: 0.028011 sec","job_status":"done","queue_duration_s":2.723138,"scheduling_latency_s":2.72318,"redis_calls":13,"redis_duration_s":0.0032970000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028011,"completed_at":"2026-09-09T10:35:12.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 222.714499] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:12.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4939fa3679280ca7c1f19b4c","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4939fa3679280ca7c1f19b4c: start","job_status":"start","queue_duration_s":2.755337,"scheduling_latency_s":2.755384}1588gitlab # [ 222.717062] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4939fa3679280ca7c1f19b4c","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4939fa3679280ca7c1f19b4c: done: 0.044997 sec","job_status":"done","queue_duration_s":2.755337,"scheduling_latency_s":2.755384,"redis_calls":13,"redis_duration_s":0.004922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044997,"completed_at":"2026-09-09T10:35:13.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 222.799347] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8216ab90d167a011562b8d41","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8216ab90d167a011562b8d41: start","job_status":"start","queue_duration_s":2.80323,"scheduling_latency_s":2.803277}1590gitlab # [ 222.800932] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8216ab90d167a011562b8d41","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8216ab90d167a011562b8d41: done: 0.027578 sec","job_status":"done","queue_duration_s":2.80323,"scheduling_latency_s":2.803277,"redis_calls":13,"redis_duration_s":0.0032129999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001175,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027578,"completed_at":"2026-09-09T10:35:13.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 222.908290] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7ae945c2ecd535babc08a90","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7ae945c2ecd535babc08a90: start","job_status":"start","queue_duration_s":2.832981,"scheduling_latency_s":2.833023}1592gitlab # [ 222.909908] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7ae945c2ecd535babc08a90","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7ae945c2ecd535babc08a90: done: 0.037886 sec","job_status":"done","queue_duration_s":2.832981,"scheduling_latency_s":2.833023,"redis_calls":13,"redis_duration_s":0.004762,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037886,"completed_at":"2026-09-09T10:35:13.070Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 223.007998] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ac56ce5fb87a2e175f3f2d8","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ac56ce5fb87a2e175f3f2d8: start","job_status":"start","queue_duration_s":2.875935,"scheduling_latency_s":2.875988}1594gitlab # [ 223.009454] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ac56ce5fb87a2e175f3f2d8","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ac56ce5fb87a2e175f3f2d8: done: 0.034672 sec","job_status":"done","queue_duration_s":2.875935,"scheduling_latency_s":2.875988,"redis_calls":13,"redis_duration_s":0.004276,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034672,"completed_at":"2026-09-09T10:35:13.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 223.022451] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e99d8ecd077b0b6ec37c560b","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e99d8ecd077b0b6ec37c560b: start","job_status":"start","queue_duration_s":2.912681,"scheduling_latency_s":2.912721}1596gitlab # [ 223.114860] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e99d8ecd077b0b6ec37c560b","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e99d8ecd077b0b6ec37c560b: done: 0.033087 sec","job_status":"done","queue_duration_s":2.912681,"scheduling_latency_s":2.912721,"redis_calls":13,"redis_duration_s":0.004309,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001686,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002623,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033087,"completed_at":"2026-09-09T10:35:13.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 223.115265] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed9c6057eb6f5ad206c03180","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed9c6057eb6f5ad206c03180: start","job_status":"start","queue_duration_s":2.948756,"scheduling_latency_s":2.948836}1598gitlab # [ 223.208109] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed9c6057eb6f5ad206c03180","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed9c6057eb6f5ad206c03180: done: 0.036342 sec","job_status":"done","queue_duration_s":2.948756,"scheduling_latency_s":2.948836,"redis_calls":13,"redis_duration_s":0.004285,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036342,"completed_at":"2026-09-09T10:35:13.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 223.273099] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8529583dcf6c738253a70d23","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8529583dcf6c738253a70d23: start","job_status":"start","queue_duration_s":2.987613,"scheduling_latency_s":2.987657}1600gitlab # [ 223.274284] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8529583dcf6c738253a70d23","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8529583dcf6c738253a70d23: done: 0.033987 sec","job_status":"done","queue_duration_s":2.987613,"scheduling_latency_s":2.987657,"redis_calls":13,"redis_duration_s":0.005213000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00269,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002523,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033987,"completed_at":"2026-09-09T10:35:13.221Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 223.339404] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a66c86c771038abae8cbd22","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a66c86c771038abae8cbd22: start","job_status":"start","queue_duration_s":3.024357,"scheduling_latency_s":3.024423}1602gitlab # [ 223.341540] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a66c86c771038abae8cbd22","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a66c86c771038abae8cbd22: done: 0.034202 sec","job_status":"done","queue_duration_s":3.024357,"scheduling_latency_s":3.024423,"redis_calls":13,"redis_duration_s":0.004251,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002666,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034202,"completed_at":"2026-09-09T10:35:13.258Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 223.418193] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fb09bf268acb6ee8c6c6b6a","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fb09bf268acb6ee8c6c6b6a: start","job_status":"start","queue_duration_s":3.061572,"scheduling_latency_s":3.061626}1604gitlab # [ 223.419548] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fb09bf268acb6ee8c6c6b6a","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fb09bf268acb6ee8c6c6b6a: done: 0.038014 sec","job_status":"done","queue_duration_s":3.061572,"scheduling_latency_s":3.061626,"redis_calls":13,"redis_duration_s":0.004656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038014,"completed_at":"2026-09-09T10:35:13.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 223.461823] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dcc657d43ab10f5c136679c","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dcc657d43ab10f5c136679c: start","job_status":"start","queue_duration_s":3.102691,"scheduling_latency_s":3.102739}1606gitlab # [ 223.483402] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dcc657d43ab10f5c136679c","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dcc657d43ab10f5c136679c: done: 0.040517 sec","job_status":"done","queue_duration_s":3.102691,"scheduling_latency_s":3.102739,"redis_calls":13,"redis_duration_s":0.00435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001445,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040517,"completed_at":"2026-09-09T10:35:13.343Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 223.560456] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56498c81c632b68fd6c0b253","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56498c81c632b68fd6c0b253: start","job_status":"start","queue_duration_s":3.145574,"scheduling_latency_s":3.145616}1608gitlab # [ 223.622664] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56498c81c632b68fd6c0b253","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56498c81c632b68fd6c0b253: done: 0.029318 sec","job_status":"done","queue_duration_s":3.145574,"scheduling_latency_s":3.145616,"redis_calls":13,"redis_duration_s":0.0034410000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002256,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029318,"completed_at":"2026-09-09T10:35:13.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 223.695856] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb99031f4a13c13c0722f63b","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb99031f4a13c13c0722f63b: start","job_status":"start","queue_duration_s":3.177247,"scheduling_latency_s":3.177291}1610gitlab # [ 223.697274] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb99031f4a13c13c0722f63b","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb99031f4a13c13c0722f63b: done: 0.029465 sec","job_status":"done","queue_duration_s":3.177247,"scheduling_latency_s":3.177291,"redis_calls":13,"redis_duration_s":0.003343,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029465,"completed_at":"2026-09-09T10:35:13.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 223.782075] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b210a090ac76d74a3dc94d9","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b210a090ac76d74a3dc94d9: start","job_status":"start","queue_duration_s":3.208965,"scheduling_latency_s":3.209013}1612gitlab # [ 223.782519] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b210a090ac76d74a3dc94d9","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b210a090ac76d74a3dc94d9: done: 0.041739 sec","job_status":"done","queue_duration_s":3.208965,"scheduling_latency_s":3.209013,"redis_calls":13,"redis_duration_s":0.004874,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001769,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041739,"completed_at":"2026-09-09T10:35:13.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 223.873096] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"620c8a68957361fd6f83c1a0","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-620c8a68957361fd6f83c1a0: start","job_status":"start","queue_duration_s":3.253563,"scheduling_latency_s":3.25361}1614gitlab # [ 223.874191] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"620c8a68957361fd6f83c1a0","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-620c8a68957361fd6f83c1a0: done: 0.031791 sec","job_status":"done","queue_duration_s":3.253563,"scheduling_latency_s":3.25361,"redis_calls":13,"redis_duration_s":0.0035380000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002269,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031791,"completed_at":"2026-09-09T10:35:13.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 223.899660] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14f6645e09eb30b9f7c0045f","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14f6645e09eb30b9f7c0045f: start","job_status":"start","queue_duration_s":3.287655,"scheduling_latency_s":3.287697}1616gitlab # [ 223.995163] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14f6645e09eb30b9f7c0045f","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14f6645e09eb30b9f7c0045f: done: 0.034725 sec","job_status":"done","queue_duration_s":3.287655,"scheduling_latency_s":3.287697,"redis_calls":13,"redis_duration_s":0.003841,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002489,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034725,"completed_at":"2026-09-09T10:35:13.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 224.072437] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d803c682c20a051164df726c","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d803c682c20a051164df726c: start","job_status":"start","queue_duration_s":3.325339,"scheduling_latency_s":3.325384}1618gitlab # [ 224.073534] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d803c682c20a051164df726c","created_at":"2026-09-09T10:35:09.977Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-06bcd1975b5b4273","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cc883d49cffcaca3b11ffc309d632ede","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.200Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d803c682c20a051164df726c: done: 0.036151 sec","job_status":"done","queue_duration_s":3.325339,"scheduling_latency_s":3.325384,"redis_calls":13,"redis_duration_s":0.004119,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002759,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036151,"completed_at":"2026-09-09T10:35:13.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 224.093835] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.565Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"928ac12b90634a5368d6cbcf","created_at":"2026-09-09T10:35:10.917Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2d532d13023f4190","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9164390a8ed1e690c6efe7869665068b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.943Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-928ac12b90634a5368d6cbcf: start","job_status":"start","queue_duration_s":2.621517,"scheduling_latency_s":2.621591}1620gitlab # [ 224.167133] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.586Z","message":"No existing merge request to be cleaned up."}1621gitlab # [ 224.168576] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.607Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"928ac12b90634a5368d6cbcf","created_at":"2026-09-09T10:35:10.917Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2d532d13023f4190","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9164390a8ed1e690c6efe7869665068b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.943Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-928ac12b90634a5368d6cbcf: done: 0.042877 sec","job_status":"done","queue_duration_s":2.621517,"scheduling_latency_s":2.621591,"redis_calls":10,"redis_duration_s":0.003748,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001693,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002055,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042877,"completed_at":"2026-09-09T10:35:13.607Z","load_balancing_strategy":"primary","db_duration_s":0.003289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1622gitlab # [ 224.171203] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.611Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f18b73dee852141ad0275861","created_at":"2026-09-09T10:35:10.917Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2d532d13023f4190","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9164390a8ed1e690c6efe7869665068b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.943Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f18b73dee852141ad0275861: start","job_status":"start","queue_duration_s":2.667449,"scheduling_latency_s":2.667497}1623gitlab # [ 224.227928] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.636Z","message":"No existing merge request to be cleaned up."}1624gitlab # [ 224.229644] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.658Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f18b73dee852141ad0275861","created_at":"2026-09-09T10:35:10.917Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2d532d13023f4190","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9164390a8ed1e690c6efe7869665068b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.943Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f18b73dee852141ad0275861: done: 0.047333 sec","job_status":"done","queue_duration_s":2.667449,"scheduling_latency_s":2.667497,"redis_calls":10,"redis_duration_s":0.0040750000000000005,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00169,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002385,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047333,"completed_at":"2026-09-09T10:35:13.658Z","load_balancing_strategy":"primary","db_duration_s":0.003149,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 224.297588] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.661Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c51f0135a13e6c23490d6fd8","created_at":"2026-09-09T10:35:10.917Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2d532d13023f4190","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9164390a8ed1e690c6efe7869665068b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.943Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c51f0135a13e6c23490d6fd8: start","job_status":"start","queue_duration_s":2.717694,"scheduling_latency_s":2.71774}1626gitlab # [ 224.298718] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.681Z","message":"No existing merge request to be cleaned up."}1627gitlab # [ 224.304303] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.698Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c51f0135a13e6c23490d6fd8","created_at":"2026-09-09T10:35:10.917Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2d532d13023f4190","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9164390a8ed1e690c6efe7869665068b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.943Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c51f0135a13e6c23490d6fd8: done: 0.037806 sec","job_status":"done","queue_duration_s":2.717694,"scheduling_latency_s":2.71774,"redis_calls":10,"redis_duration_s":0.003238,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037806,"completed_at":"2026-09-09T10:35:13.698Z","load_balancing_strategy":"primary","db_duration_s":0.002617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628gitlab # [ 224.395572] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.701Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"01e4d311b846c705882a6e50","created_at":"2026-09-09T10:35:10.917Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2d532d13023f4190","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9164390a8ed1e690c6efe7869665068b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.943Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-01e4d311b846c705882a6e50: start","job_status":"start","queue_duration_s":2.758396,"scheduling_latency_s":2.758444}1629gitlab # [ 224.396760] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.728Z","message":"No existing merge request to be cleaned up."}1630gitlab # [ 224.397038] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:35:13.749Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"01e4d311b846c705882a6e50","created_at":"2026-09-09T10:35:10.917Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2d532d13023f4190","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9164390a8ed1e690c6efe7869665068b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:10.943Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-01e4d311b846c705882a6e50: done: 0.047193 sec","job_status":"done","queue_duration_s":2.758396,"scheduling_latency_s":2.758444,"redis_calls":11,"redis_duration_s":0.004508,"redis_read_bytes":136,"redis_write_bytes":1131,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":109,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002459,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047193,"completed_at":"2026-09-09T10:35:13.748Z","load_balancing_strategy":"primary","db_duration_s":0.003101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 273.412752] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:04.665Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"09c4f8c46358c4c700a78e29","created_at":"2026-09-09T10:36:04.642Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c10d83f1088f375ee594526be4433570","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.661Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-09c4f8c46358c4c700a78e29: start","job_status":"start","queue_duration_s":0.003784,"scheduling_latency_s":0.003832}1632gitlab # [ 273.525861] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:04.777Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"09c4f8c46358c4c700a78e29","created_at":"2026-09-09T10:36:04.642Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c10d83f1088f375ee594526be4433570","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.661Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-09c4f8c46358c4c700a78e29: done: 0.111429 sec","job_status":"done","queue_duration_s":0.003784,"scheduling_latency_s":0.003832,"redis_calls":9,"redis_duration_s":0.016195,"redis_read_bytes":137,"redis_write_bytes":940,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010609,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005329,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.111429,"completed_at":"2026-09-09T10:36:04.776Z","load_balancing_strategy":"primary","db_duration_s":0.020978,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633gitlab # [ 273.530810] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:04.780Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8e6733577369ee07a11d83d3","created_at":"2026-09-09T10:36:04.720Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8674ce2e387e7c29a4bde7d24eb71af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.738Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8e6733577369ee07a11d83d3: start","job_status":"start","queue_duration_s":0.041916,"scheduling_latency_s":0.041973}1634gitlab # [ 273.622803] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:04.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8e6733577369ee07a11d83d3","created_at":"2026-09-09T10:36:04.720Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8674ce2e387e7c29a4bde7d24eb71af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.738Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8e6733577369ee07a11d83d3: done: 0.095177 sec","job_status":"done","queue_duration_s":0.041916,"scheduling_latency_s":0.041973,"redis_calls":11,"redis_duration_s":0.041912,"redis_read_bytes":139,"redis_write_bytes":1171,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.009383,"redis_feature_flag_read_bytes":132,"redis_feature_flag_write_bytes":99,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.014511,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.018018,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002861258,"exclusive_lock_hold_duration_s":0.009673296,"duration_s":0.095177,"completed_at":"2026-09-09T10:36:04.875Z","load_balancing_strategy":"primary","db_duration_s":0.003454,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 273.636550] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:04.889Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4afef3dbc2195067c6e8e38d","created_at":"2026-09-09T10:36:04.767Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22f202f1f31f83352872b39c3a989c02","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.810Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4afef3dbc2195067c6e8e38d: start","job_status":"start","queue_duration_s":0.079347,"scheduling_latency_s":0.079402}1636gitlab # [ 273.722247] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:04.971Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4afef3dbc2195067c6e8e38d","created_at":"2026-09-09T10:36:04.767Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22f202f1f31f83352872b39c3a989c02","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.810Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4afef3dbc2195067c6e8e38d: done: 0.081494 sec","job_status":"done","queue_duration_s":0.079347,"scheduling_latency_s":0.079402,"redis_calls":11,"redis_duration_s":0.019448,"redis_read_bytes":138,"redis_write_bytes":877,"redis_cache_calls":3,"redis_cache_duration_s":0.005486,"redis_cache_read_bytes":5,"redis_cache_write_bytes":97,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":84,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002516,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.081494,"completed_at":"2026-09-09T10:36:04.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 273.808959] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.062Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8b853020564847db0e9832e4","created_at":"2026-09-09T10:36:04.862Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03f05217f1b984d1b519ef6fa857ed67","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.883Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8b853020564847db0e9832e4: start","job_status":"start","queue_duration_s":0.179094,"scheduling_latency_s":0.179137}1638gitlab # [ 273.948167] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8b853020564847db0e9832e4","created_at":"2026-09-09T10:36:04.862Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03f05217f1b984d1b519ef6fa857ed67","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.883Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8b853020564847db0e9832e4: done: 0.138841 sec","job_status":"done","queue_duration_s":0.179094,"scheduling_latency_s":0.179137,"redis_calls":8,"redis_duration_s":0.024765,"redis_read_bytes":133,"redis_write_bytes":888,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00348,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017044,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.138841,"completed_at":"2026-09-09T10:36:05.201Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 274.014902] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5da693d90c5cac111eafd0ce","created_at":"2026-09-09T10:36:04.911Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a0ad315d718c5f6e0e31fbf2d2eb458","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:36:04.928Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5da693d90c5cac111eafd0ce: start","job_status":"start","queue_duration_s":0.340083,"scheduling_latency_s":0.340136}1640gitlab # [ 274.088852] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.338Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1641gitlab # [ 274.125367] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5da693d90c5cac111eafd0ce","created_at":"2026-09-09T10:36:04.911Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a0ad315d718c5f6e0e31fbf2d2eb458","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:36:04.928Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5da693d90c5cac111eafd0ce: done: 0.109071 sec","job_status":"done","queue_duration_s":0.340083,"scheduling_latency_s":0.340136,"redis_calls":8,"redis_duration_s":0.024895,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.003272,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017408,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004215,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.109071,"completed_at":"2026-09-09T10:36:05.376Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 274.210751] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e2515ccdaa4ddb2957ff09aa","created_at":"2026-09-09T10:36:04.949Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1da4aa023dbf02cb323dae529060df7d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.962Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e2515ccdaa4ddb2957ff09aa: start","job_status":"start","queue_duration_s":0.419758,"scheduling_latency_s":0.419822}1643gitlab # [ 274.307435] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e2515ccdaa4ddb2957ff09aa","created_at":"2026-09-09T10:36:04.949Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1da4aa023dbf02cb323dae529060df7d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.962Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e2515ccdaa4ddb2957ff09aa: done: 0.178175 sec","job_status":"done","queue_duration_s":0.419758,"scheduling_latency_s":0.419822,"redis_calls":10,"redis_duration_s":0.034038,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001444,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012193,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.020401,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.015663723,"exclusive_lock_hold_duration_s":0.045724527,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.178175,"completed_at":"2026-09-09T10:36:05.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644gitlab # [ 274.379138] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.632Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"90f6efeb1d8f24df81772f5a","created_at":"2026-09-09T10:36:05.063Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"711bdac24f283d8747d68e1ecd8c5690","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.109Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-90f6efeb1d8f24df81772f5a: start","job_status":"start","queue_duration_s":0.522947,"scheduling_latency_s":0.522996}1645gitlab # [ 274.440063] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.693Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1646gitlab # [ 274.490156] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"90f6efeb1d8f24df81772f5a","created_at":"2026-09-09T10:36:05.063Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"711bdac24f283d8747d68e1ecd8c5690","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.109Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-90f6efeb1d8f24df81772f5a: done: 0.108856 sec","job_status":"done","queue_duration_s":0.522947,"scheduling_latency_s":0.522996,"redis_calls":8,"redis_duration_s":0.01662,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.002823,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010242,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003555,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.108856,"completed_at":"2026-09-09T10:36:05.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647gitlab # [ 274.553690] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f7ebdf6b3177050ef61c140a","created_at":"2026-09-09T10:36:05.185Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56dbe84e2ff16421a630c789b8a6a0b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:36:05.205Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f7ebdf6b3177050ef61c140a: start","job_status":"start","queue_duration_s":0.601574,"scheduling_latency_s":0.601629}1648gitlab # [ 274.637673] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:05.891Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1649gitlab # [ 274.818830] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:06.069Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f7ebdf6b3177050ef61c140a","created_at":"2026-09-09T10:36:05.185Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56dbe84e2ff16421a630c789b8a6a0b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:36:05.205Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f7ebdf6b3177050ef61c140a: done: 0.262728 sec","job_status":"done","queue_duration_s":0.601574,"scheduling_latency_s":0.601629,"redis_calls":14,"redis_duration_s":0.050009000000000005,"redis_read_bytes":901,"redis_write_bytes":1299,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.025427,"redis_feature_flag_read_bytes":896,"redis_feature_flag_write_bytes":498,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017606,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006976,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.262728,"completed_at":"2026-09-09T10:36:06.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650gitlab # [ 274.950338] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:06.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"463b5443d4fd239c9596221e","created_at":"2026-09-09T10:36:05.311Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1def3675224da3948e8bfc1aa91b3bac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.328Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-463b5443d4fd239c9596221e: start","job_status":"start","queue_duration_s":0.874077,"scheduling_latency_s":0.87413}1651gitlab # [ 275.335379] postgres[2790]: [2790] ERROR: relation "table_without_models" does not exist1652gitlab # [ 275.339270] postgres[2790]: [2790] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1653gitlab # [ 276.477272] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:07.729Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"463b5443d4fd239c9596221e","created_at":"2026-09-09T10:36:05.311Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1def3675224da3948e8bfc1aa91b3bac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.328Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-463b5443d4fd239c9596221e: done: 1.527491 sec","job_status":"done","queue_duration_s":0.874077,"scheduling_latency_s":0.87413,"redis_calls":12,"redis_duration_s":0.052967,"redis_read_bytes":391,"redis_write_bytes":1213,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.008302,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":226,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.024717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.019948,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.463,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":129,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.463,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.501242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.003512178,"exclusive_lock_hold_duration_s":1.36572218,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":1.527491,"completed_at":"2026-09-09T10:36:07.729Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.904784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 276.482665] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:07.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1b39fbc274aa1f039ccf8937","created_at":"2026-09-09T10:36:05.348Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"810bf391b14cb70277c012572d878817","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.365Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1b39fbc274aa1f039ccf8937: start","job_status":"start","queue_duration_s":2.370787,"scheduling_latency_s":2.370827}1655gitlab # [ 278.352995] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:09.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1b39fbc274aa1f039ccf8937","created_at":"2026-09-09T10:36:05.348Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"810bf391b14cb70277c012572d878817","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.365Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1b39fbc274aa1f039ccf8937: done: 1.867181 sec","job_status":"done","queue_duration_s":2.370787,"scheduling_latency_s":2.370827,"redis_calls":563,"redis_duration_s":1.245973,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001698,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":1.233578,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.644866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.867181,"completed_at":"2026-09-09T10:36:09.603Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656gitlab # [ 278.437962] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:09.691Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"25c9e690925769f68c91cdcf","created_at":"2026-09-09T10:36:05.405Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"148adee7bb3ac84fcbaaaf924df5b5e3","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.419Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-25c9e690925769f68c91cdcf: start","job_status":"start","queue_duration_s":4.271398,"scheduling_latency_s":4.271506}1657gitlab # [ 278.558060] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:09.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"25c9e690925769f68c91cdcf","created_at":"2026-09-09T10:36:05.405Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"148adee7bb3ac84fcbaaaf924df5b5e3","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.419Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-25c9e690925769f68c91cdcf: done: 0.120155 sec","job_status":"done","queue_duration_s":4.271398,"scheduling_latency_s":4.271506,"redis_calls":10,"redis_duration_s":0.030308,"redis_read_bytes":389,"redis_write_bytes":923,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.011234,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":242,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013336,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005738,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.120155,"completed_at":"2026-09-09T10:36:09.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 278.631203] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:09.884Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f9e5661641768ff36d389ba6","created_at":"2026-09-09T10:36:05.454Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8080ca183cfe9edefc1af733f4b83025","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.467Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f9e5661641768ff36d389ba6: start","job_status":"start","queue_duration_s":4.416868,"scheduling_latency_s":4.416927}1659gitlab # [ 278.926300] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:10.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f9e5661641768ff36d389ba6","created_at":"2026-09-09T10:36:05.454Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8080ca183cfe9edefc1af733f4b83025","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.467Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f9e5661641768ff36d389ba6: done: 0.293683 sec","job_status":"done","queue_duration_s":4.416868,"scheduling_latency_s":4.416927,"redis_calls":11,"redis_duration_s":0.021417,"redis_read_bytes":517,"redis_write_bytes":1217,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.006672,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":386,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012365,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.293683,"completed_at":"2026-09-09T10:36:10.177Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 279.005127] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:10.258Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"728503e27ece3850fb4f6178","created_at":"2026-09-09T10:36:05.494Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e05a621f70235b5c279dce91f3e62e93","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.507Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-728503e27ece3850fb4f6178: start","job_status":"start","queue_duration_s":4.750768,"scheduling_latency_s":4.750827}1661gitlab # [ 279.132903] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:10.385Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"728503e27ece3850fb4f6178","created_at":"2026-09-09T10:36:05.494Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e05a621f70235b5c279dce91f3e62e93","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.507Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-728503e27ece3850fb4f6178: done: 0.127594 sec","job_status":"done","queue_duration_s":4.750768,"scheduling_latency_s":4.750827,"redis_calls":12,"redis_duration_s":0.023527,"redis_read_bytes":264,"redis_write_bytes":1466,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005234,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":227,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01293,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005363,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.021582911,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.127594,"completed_at":"2026-09-09T10:36:10.385Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021275,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1662gitlab # [ 279.191825] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:10.398Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ddf8dd11babce92debb921dd","created_at":"2026-09-09T10:36:05.519Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68204fddb8469f2cedde17e593d05153","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.525Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ddf8dd11babce92debb921dd: start","job_status":"start","queue_duration_s":4.872758,"scheduling_latency_s":4.872817}1663gitlab # [ 279.259664] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:10.512Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ddf8dd11babce92debb921dd","created_at":"2026-09-09T10:36:05.519Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68204fddb8469f2cedde17e593d05153","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.525Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ddf8dd11babce92debb921dd: done: 0.114554 sec","job_status":"done","queue_duration_s":4.872758,"scheduling_latency_s":4.872817,"redis_calls":11,"redis_duration_s":0.056036,"redis_read_bytes":263,"redis_write_bytes":1308,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.011677,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":221,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.033979,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.01038,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002673524,"exclusive_lock_hold_duration_s":0.012489017,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.114554,"completed_at":"2026-09-09T10:36:10.512Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 279.292295] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:10.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"48f8c5ae2fba33d747c382c7","created_at":"2026-09-09T10:36:05.547Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.553Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-48f8c5ae2fba33d747c382c7: start","job_status":"start","queue_duration_s":4.963713,"scheduling_latency_s":4.963763}1665gitlab # [ 279.886565] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"48f8c5ae2fba33d747c382c7","created_at":"2026-09-09T10:36:05.547Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.553Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-48f8c5ae2fba33d747c382c7: done: 0.622245 sec","job_status":"done","queue_duration_s":4.963713,"scheduling_latency_s":4.963763,"redis_calls":62,"redis_duration_s":0.200928,"redis_read_bytes":364,"redis_write_bytes":41330,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000593,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":221,"redis_queues_calls":2,"redis_queues_duration_s":0.001297,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.150483,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.048555,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.236788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.622245,"completed_at":"2026-09-09T10:36:11.139Z","load_balancing_strategy":"primary","db_duration_s":0.019754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666gitlab # [ 279.966772] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.218Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a99a1676b47bd811302754a4","created_at":"2026-09-09T10:36:05.567Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a37c37e98b016634b10d39f0abff4f85","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:36:05.571Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a99a1676b47bd811302754a4: start","job_status":"start","queue_duration_s":5.647034,"scheduling_latency_s":5.647104}1667gitlab # [ 280.088156] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.340Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a99a1676b47bd811302754a4","created_at":"2026-09-09T10:36:05.567Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a37c37e98b016634b10d39f0abff4f85","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:36:05.571Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a99a1676b47bd811302754a4: done: 0.121703 sec","job_status":"done","queue_duration_s":5.647034,"scheduling_latency_s":5.647104,"redis_calls":9,"redis_duration_s":0.023046999999999998,"redis_read_bytes":261,"redis_write_bytes":958,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004692,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":217,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011895,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00646,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.121703,"completed_at":"2026-09-09T10:36:11.340Z","load_balancing_strategy":"primary","db_duration_s":0.010506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 280.165817] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.349Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c9ed3eda1d922bacb1a528bc","created_at":"2026-09-09T10:36:05.627Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7662cb63867db08d01bbbc9c6bd9cff3","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.635Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c9ed3eda1d922bacb1a528bc: start","job_status":"start","queue_duration_s":5.714271,"scheduling_latency_s":5.714322}1669gitlab # [ 280.189571] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.421Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c9ed3eda1d922bacb1a528bc","created_at":"2026-09-09T10:36:05.627Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7662cb63867db08d01bbbc9c6bd9cff3","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.635Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c9ed3eda1d922bacb1a528bc: done: 0.071284 sec","job_status":"done","queue_duration_s":5.714271,"scheduling_latency_s":5.714322,"redis_calls":12,"redis_duration_s":0.020064,"redis_read_bytes":645,"redis_write_bytes":1127,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.013818,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":416,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003932,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002314,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.071284,"completed_at":"2026-09-09T10:36:11.420Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009222,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 280.228150] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.429Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"0b3457d7eef2da1c1955f668","created_at":"2026-09-09T10:36:05.660Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"661feac1df9d21b18c628a84aeaf762a","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.701Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-0b3457d7eef2da1c1955f668: start","job_status":"start","queue_duration_s":5.727631,"scheduling_latency_s":5.727689}1671gitlab # [ 280.295148] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.548Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"0b3457d7eef2da1c1955f668","created_at":"2026-09-09T10:36:05.660Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"661feac1df9d21b18c628a84aeaf762a","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.701Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-0b3457d7eef2da1c1955f668: done: 0.11906 sec","job_status":"done","queue_duration_s":5.727631,"scheduling_latency_s":5.727689,"redis_calls":10,"redis_duration_s":0.02197,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00486,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015041,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002069,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004170363,"extra.ci_runners_stale_machines_cleanup_cron_worker.status":"success","extra.ci_runners_stale_machines_cleanup_cron_worker.total_deleted":0,"extra.ci_runners_stale_machines_cleanup_cron_worker.batch_counts":[0],"duration_s":0.11906,"completed_at":"2026-09-09T10:36:11.548Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672gitlab # [ 280.371857] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ea0c53728812933211cc2219","created_at":"2026-09-09T10:36:05.734Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e80e1e23db454d0a9cba0ad0395ef7a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.746Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ea0c53728812933211cc2219: start","job_status":"start","queue_duration_s":5.879101,"scheduling_latency_s":5.879142}1673gitlab # [ 280.430110] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.683Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1674gitlab # [ 280.453098] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ea0c53728812933211cc2219","created_at":"2026-09-09T10:36:05.734Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e80e1e23db454d0a9cba0ad0395ef7a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.746Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ea0c53728812933211cc2219: done: 0.079647 sec","job_status":"done","queue_duration_s":5.879101,"scheduling_latency_s":5.879142,"redis_calls":9,"redis_duration_s":0.02453,"redis_read_bytes":261,"redis_write_bytes":1002,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004935,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":231,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.015437,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004158,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079647,"completed_at":"2026-09-09T10:36:11.704Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1675gitlab # [ 280.522273] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.708Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"bc73e50c454ec49edaf6c57a","created_at":"2026-09-09T10:36:05.854Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd9594d146fe114eae342abc03465258","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.876Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-bc73e50c454ec49edaf6c57a: start","job_status":"start","queue_duration_s":5.831708,"scheduling_latency_s":5.831749}1676gitlab # [ 280.582038] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"bc73e50c454ec49edaf6c57a","created_at":"2026-09-09T10:36:05.854Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd9594d146fe114eae342abc03465258","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.876Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-bc73e50c454ec49edaf6c57a: done: 0.125174 sec","job_status":"done","queue_duration_s":5.831708,"scheduling_latency_s":5.831749,"redis_calls":12,"redis_duration_s":0.030044,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005726,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010347,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.013971,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001704966,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.125174,"completed_at":"2026-09-09T10:36:11.833Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1677gitlab # [ 280.655499] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"47cc132017025cc0a1f85783","created_at":"2026-09-09T10:36:05.922Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81cfca01bf74ee1ef751b99e2d36540f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.955Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-47cc132017025cc0a1f85783: start","job_status":"start","queue_duration_s":5.951914,"scheduling_latency_s":5.951967}1678gitlab # [ 280.738104] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:11.991Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1679gitlab # [ 280.818133] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.069Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"47cc132017025cc0a1f85783","created_at":"2026-09-09T10:36:05.922Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81cfca01bf74ee1ef751b99e2d36540f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.955Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-47cc132017025cc0a1f85783: done: 0.16194 sec","job_status":"done","queue_duration_s":5.951914,"scheduling_latency_s":5.951967,"redis_calls":9,"redis_duration_s":0.020157,"redis_read_bytes":261,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005243,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":247,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004788,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.16194,"completed_at":"2026-09-09T10:36:12.068Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 280.866084] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"99d26614f438990f2542c59c","created_at":"2026-09-09T10:36:05.979Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"091cf34e8d64c433979347ad91ce7795","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.199Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-99d26614f438990f2542c59c: start","job_status":"start","queue_duration_s":5.874747,"scheduling_latency_s":5.8748}1681gitlab # [ 281.061765] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"99d26614f438990f2542c59c","created_at":"2026-09-09T10:36:05.979Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"091cf34e8d64c433979347ad91ce7795","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.199Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-99d26614f438990f2542c59c: done: 0.239184 sec","job_status":"done","queue_duration_s":5.874747,"scheduling_latency_s":5.8748,"redis_calls":20,"redis_duration_s":0.048542999999999996,"redis_read_bytes":20,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.012024,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.004874,"redis_queues_read_bytes":3,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.026642,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.005003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002117587,"duration_s":0.239184,"completed_at":"2026-09-09T10:36:12.313Z","load_balancing_strategy":"primary","db_duration_s":0.011428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682gitlab # [ 281.067450] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.320Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"cff69c5f669c5ddc02a40306","created_at":"2026-09-09T10:36:06.258Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25b3e800f03a17f867949060f01c66ee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.277Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-cff69c5f669c5ddc02a40306: start","job_status":"start","queue_duration_s":6.043601,"scheduling_latency_s":6.043643}1683gitlab # [ 281.160866] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.358Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1684gitlab # [ 281.167102] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.385Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"cff69c5f669c5ddc02a40306","created_at":"2026-09-09T10:36:06.258Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25b3e800f03a17f867949060f01c66ee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.277Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-cff69c5f669c5ddc02a40306: done: 0.064226 sec","job_status":"done","queue_duration_s":6.043601,"scheduling_latency_s":6.043643,"redis_calls":9,"redis_duration_s":0.031017,"redis_read_bytes":261,"redis_write_bytes":1075,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004488,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":249,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012879,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.01365,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064226,"completed_at":"2026-09-09T10:36:12.384Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1685gitlab # [ 281.232191] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.394Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"cab0c74ab8f816ffffcfc110","created_at":"2026-09-09T10:36:06.320Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c555412ed445b8a2c03a3ff6e8a141b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.330Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-cab0c74ab8f816ffffcfc110: start","job_status":"start","queue_duration_s":6.063929,"scheduling_latency_s":6.063975}1686gitlab # [ 281.323035] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"cab0c74ab8f816ffffcfc110","created_at":"2026-09-09T10:36:06.320Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c555412ed445b8a2c03a3ff6e8a141b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.330Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-cab0c74ab8f816ffffcfc110: done: 0.18014 sec","job_status":"done","queue_duration_s":6.063929,"scheduling_latency_s":6.063975,"redis_calls":12,"redis_duration_s":0.025403,"redis_read_bytes":391,"redis_write_bytes":1466,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00746,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":304,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010724,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.074,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.074,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.004084318,"exclusive_lock_hold_duration_s":0.106892636,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.18014,"completed_at":"2026-09-09T10:36:12.574Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.078704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1687gitlab # [ 281.393374] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.646Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"363cec67067ac70b987b03d4","created_at":"2026-09-09T10:36:06.376Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"308a4b7521e839ddcd4cf3a7e731a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.398Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-363cec67067ac70b987b03d4: start","job_status":"start","queue_duration_s":6.248249,"scheduling_latency_s":6.248299}1688gitlab # [ 281.519561] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"363cec67067ac70b987b03d4","created_at":"2026-09-09T10:36:06.376Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"308a4b7521e839ddcd4cf3a7e731a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.398Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-363cec67067ac70b987b03d4: done: 0.126131 sec","job_status":"done","queue_duration_s":6.248249,"scheduling_latency_s":6.248299,"redis_calls":18,"redis_duration_s":0.027771,"redis_read_bytes":20,"redis_write_bytes":4718,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003522,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":688,"redis_queues_calls":2,"redis_queues_duration_s":0.000551,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.018272,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.005426,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.126131,"completed_at":"2026-09-09T10:36:12.772Z","load_balancing_strategy":"primary","db_duration_s":0.007662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1689gitlab # [ 281.524055] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.777Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9c16c18b19da318929220b9c","created_at":"2026-09-09T10:36:06.450Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d95d4157ac8c8db7fbe34861ef15b53d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.470Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9c16c18b19da318929220b9c: start","job_status":"start","queue_duration_s":6.307188,"scheduling_latency_s":6.30724}1690gitlab # [ 281.612575] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9c16c18b19da318929220b9c","created_at":"2026-09-09T10:36:06.450Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d95d4157ac8c8db7fbe34861ef15b53d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.470Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9c16c18b19da318929220b9c: done: 0.044821 sec","job_status":"done","queue_duration_s":6.307188,"scheduling_latency_s":6.30724,"redis_calls":11,"redis_duration_s":0.00835,"redis_read_bytes":9,"redis_write_bytes":1516,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001668,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":740,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005487,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001195,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044821,"completed_at":"2026-09-09T10:36:12.821Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1691gitlab # [ 281.706061] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.824Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3e7910bddd3f5fa53f056699","created_at":"2026-09-09T10:36:06.510Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"52da96931f4e4934db2b14c6e818faab","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.564Z","job_size_bytes":3,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3e7910bddd3f5fa53f056699: start","job_status":"start","queue_duration_s":6.260474,"scheduling_latency_s":6.260515}1692gitlab # [ 281.707189] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.861Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3e7910bddd3f5fa53f056699","created_at":"2026-09-09T10:36:06.510Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"52da96931f4e4934db2b14c6e818faab","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.564Z","job_size_bytes":3,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3e7910bddd3f5fa53f056699: done: 0.037228 sec","job_status":"done","queue_duration_s":6.260474,"scheduling_latency_s":6.260515,"redis_calls":10,"redis_duration_s":0.007584,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000867,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003224,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003493,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069981,"duration_s":0.037228,"completed_at":"2026-09-09T10:36:12.861Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693gitlab # [ 281.779709] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.865Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"56d1397a3c85b556e289a4d0","created_at":"2026-09-09T10:36:06.602Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"858041154eff7c65dee323a01b171b84","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.614Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-56d1397a3c85b556e289a4d0: start","job_status":"start","queue_duration_s":6.250668,"scheduling_latency_s":6.250709}1694gitlab # [ 281.786856] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.895Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"56d1397a3c85b556e289a4d0","created_at":"2026-09-09T10:36:06.602Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-2ea43ff299294af8","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"858041154eff7c65dee323a01b171b84","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.614Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-56d1397a3c85b556e289a4d0: done: 0.030358 sec","job_status":"done","queue_duration_s":6.250668,"scheduling_latency_s":6.250709,"redis_calls":11,"redis_duration_s":0.002818,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000519,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001232,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000769092,"exclusive_lock_hold_duration_s":0.004419836,"duration_s":0.030358,"completed_at":"2026-09-09T10:36:12.895Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002516,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1695gitlab # [ 281.875298] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5126805df72d503c3cc51638","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5126805df72d503c3cc51638: start","job_status":"start","queue_duration_s":1.776675,"scheduling_latency_s":1.776711}1696gitlab # [ 281.877121] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5126805df72d503c3cc51638","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5126805df72d503c3cc51638: done: 0.055405 sec","job_status":"done","queue_duration_s":1.776675,"scheduling_latency_s":1.776711,"redis_calls":23,"redis_duration_s":0.006321,"redis_read_bytes":20,"redis_write_bytes":2604,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002303,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1447,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.055405,"completed_at":"2026-09-09T10:36:12.952Z","load_balancing_strategy":"primary","db_duration_s":0.006382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1697gitlab # [ 281.905734] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3ea1a1f836d1aeb9bc7bd79","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3ea1a1f836d1aeb9bc7bd79: start","job_status":"start","queue_duration_s":1.83507,"scheduling_latency_s":1.835117}1698gitlab # [ 281.976102] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3ea1a1f836d1aeb9bc7bd79","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3ea1a1f836d1aeb9bc7bd79: done: 0.032298 sec","job_status":"done","queue_duration_s":1.83507,"scheduling_latency_s":1.835117,"redis_calls":13,"redis_duration_s":0.003061,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001189,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032298,"completed_at":"2026-09-09T10:36:12.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699gitlab # [ 281.988841] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:12.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c179587dfeef70c2df98aaf6","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c179587dfeef70c2df98aaf6: start","job_status":"start","queue_duration_s":1.869775,"scheduling_latency_s":1.869818}1700gitlab # [ 282.075911] setup-gitlab-start[2228]: + systemctl restart gitlab-sidekiq.service1701gitlab # [ 282.077903] runuser[2257]: pam_unix(runuser:session): session closed for user gitlab1702gitlab # [ 282.080854] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c179587dfeef70c2df98aaf6","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c179587dfeef70c2df98aaf6: done: 0.024061 sec","job_status":"done","queue_duration_s":1.869775,"scheduling_latency_s":1.869818,"redis_calls":13,"redis_duration_s":0.0029690000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001144,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024061,"completed_at":"2026-09-09T10:36:13.014Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1703gitlab # [ 282.083677] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0a2734e2603de195e165ea4","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0a2734e2603de195e165ea4: start","job_status":"start","queue_duration_s":1.8966,"scheduling_latency_s":1.896638}1704gitlab # [ 282.150700] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0a2734e2603de195e165ea4","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0a2734e2603de195e165ea4: done: 0.03386 sec","job_status":"done","queue_duration_s":1.8966,"scheduling_latency_s":1.896638,"redis_calls":13,"redis_duration_s":0.003057,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001003,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03386,"completed_at":"2026-09-09T10:36:13.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1705gitlab # [ 282.181130] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"452504a48df13baab0858f7d","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-452504a48df13baab0858f7d: start","job_status":"start","queue_duration_s":1.932674,"scheduling_latency_s":1.932716}1706gitlab # [ 282.260574] systemd[1]: Stopping gitlab-sidekiq.service...1707gitlab # [ 282.262600] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"452504a48df13baab0858f7d","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-452504a48df13baab0858f7d: done: 0.0238 sec","job_status":"done","queue_duration_s":1.932674,"scheduling_latency_s":1.932716,"redis_calls":13,"redis_duration_s":0.0030369999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0238,"completed_at":"2026-09-09T10:36:13.077Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708gitlab # [ 282.272446] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62dace2b93efc30a5cee306c","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62dace2b93efc30a5cee306c: start","job_status":"start","queue_duration_s":1.958678,"scheduling_latency_s":1.958718}1709gitlab # [ 282.347319] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62dace2b93efc30a5cee306c","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62dace2b93efc30a5cee306c: done: 0.021742 sec","job_status":"done","queue_duration_s":1.958678,"scheduling_latency_s":1.958718,"redis_calls":13,"redis_duration_s":0.002543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001654,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021742,"completed_at":"2026-09-09T10:36:13.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710gitlab # [ 282.418435] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2886043b4f153b053e0fa11","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2886043b4f153b053e0fa11: start","job_status":"start","queue_duration_s":1.982325,"scheduling_latency_s":1.982363}1711gitlab # [ 282.420775] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2886043b4f153b053e0fa11","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2886043b4f153b053e0fa11: done: 0.02242 sec","job_status":"done","queue_duration_s":1.982325,"scheduling_latency_s":1.982363,"redis_calls":13,"redis_duration_s":0.002788,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02242,"completed_at":"2026-09-09T10:36:13.125Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712gitlab # [ 282.435495] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0283d63ece42447fc65e2aac","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0283d63ece42447fc65e2aac: start","job_status":"start","queue_duration_s":2.007674,"scheduling_latency_s":2.007713}1713gitlab # [ 282.498375] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0283d63ece42447fc65e2aac","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0283d63ece42447fc65e2aac: done: 0.025422 sec","job_status":"done","queue_duration_s":2.007674,"scheduling_latency_s":2.007713,"redis_calls":13,"redis_duration_s":0.002776,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025422,"completed_at":"2026-09-09T10:36:13.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1714gitlab # [ 282.567632] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b950c9592dd41617c173198","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b950c9592dd41617c173198: start","job_status":"start","queue_duration_s":2.034962,"scheduling_latency_s":2.034999}1715gitlab # [ 282.569174] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b950c9592dd41617c173198","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b950c9592dd41617c173198: done: 0.02167 sec","job_status":"done","queue_duration_s":2.034962,"scheduling_latency_s":2.034999,"redis_calls":13,"redis_duration_s":0.00278,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001861,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02167,"completed_at":"2026-09-09T10:36:13.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1716gitlab # [ 282.630360] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"402ee3890590152bd3b37096","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-402ee3890590152bd3b37096: start","job_status":"start","queue_duration_s":2.058503,"scheduling_latency_s":2.05854}1717gitlab # [ 282.632065] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"402ee3890590152bd3b37096","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-402ee3890590152bd3b37096: done: 0.020965 sec","job_status":"done","queue_duration_s":2.058503,"scheduling_latency_s":2.05854,"redis_calls":13,"redis_duration_s":0.002456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001604,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020965,"completed_at":"2026-09-09T10:36:13.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1718gitlab # [ 282.712287] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c37b4adcd1a9c7bff084b766","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c37b4adcd1a9c7bff084b766: start","job_status":"start","queue_duration_s":2.082106,"scheduling_latency_s":2.082149}1719gitlab # [ 282.713427] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c37b4adcd1a9c7bff084b766","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c37b4adcd1a9c7bff084b766: done: 0.050087 sec","job_status":"done","queue_duration_s":2.082106,"scheduling_latency_s":2.082149,"redis_calls":13,"redis_duration_s":0.012761999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010816,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.050087,"completed_at":"2026-09-09T10:36:13.252Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1720gitlab # [ 282.731575] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a1dd4fd5aad76ec4110cff5","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a1dd4fd5aad76ec4110cff5: start","job_status":"start","queue_duration_s":2.138014,"scheduling_latency_s":2.138064}1721gitlab # [ 282.804117] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a1dd4fd5aad76ec4110cff5","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a1dd4fd5aad76ec4110cff5: done: 0.031967 sec","job_status":"done","queue_duration_s":2.138014,"scheduling_latency_s":2.138064,"redis_calls":13,"redis_duration_s":0.007983,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002173,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00581,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031967,"completed_at":"2026-09-09T10:36:13.290Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1722gitlab # [ 282.806495] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce6657efcfa6ec914688a353","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce6657efcfa6ec914688a353: start","job_status":"start","queue_duration_s":2.173843,"scheduling_latency_s":2.1739}1723gitlab # [ 282.822113] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce6657efcfa6ec914688a353","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce6657efcfa6ec914688a353: done: 0.033387 sec","job_status":"done","queue_duration_s":2.173843,"scheduling_latency_s":2.1739,"redis_calls":13,"redis_duration_s":0.007848,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00235,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005498,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033387,"completed_at":"2026-09-09T10:36:13.327Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1724gitlab # [ 282.888408] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"635614c6ce5372659e79cc79","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-635614c6ce5372659e79cc79: start","job_status":"start","queue_duration_s":2.209111,"scheduling_latency_s":2.209149}1725gitlab # [ 282.950229] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"635614c6ce5372659e79cc79","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-635614c6ce5372659e79cc79: done: 0.040713 sec","job_status":"done","queue_duration_s":2.209111,"scheduling_latency_s":2.209149,"redis_calls":13,"redis_duration_s":0.011033000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006227,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004806,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040713,"completed_at":"2026-09-09T10:36:13.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1726gitlab # [ 282.952127] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec2c80af82ea0f7b4e93a11","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec2c80af82ea0f7b4e93a11: start","job_status":"start","queue_duration_s":2.257551,"scheduling_latency_s":2.257612}1727gitlab # [ 282.967182] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.380Z","message":"Shutting down"}1728gitlab # [ 282.969550] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.382Z","message":"Scheduler exiting..."}1729gitlab # [ 283.033751] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.383Z","message":"Terminating quiet threads for default capsule"}1730gitlab # [ 283.034930] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.386Z","message":"Scheduler exiting..."}1731gitlab # [ 283.039350] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec2c80af82ea0f7b4e93a11","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":1622,"sidekiq_tid":"made","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec2c80af82ea0f7b4e93a11: done: 0.063653 sec","job_status":"done","queue_duration_s":2.257551,"scheduling_latency_s":2.257612,"redis_calls":13,"redis_duration_s":0.010811000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002453,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008358,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.063653,"completed_at":"2026-09-09T10:36:13.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1732gitlab # [ 283.041382] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.890Z","message":"Bye!"}1733gitlab # [ 283.041969] sidekiq-cluster[1622]: {"severity":"INFO","time":"2026-09-09T10:36:13.925Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1622,"worker_id":"sidekiq_0","memwd_rss_bytes":943099904,"retry":0}1734gitlab # [ 283.687210] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1735gitlab # [ 283.687908] systemd[1]: Stopped gitlab-sidekiq.service.1736gitlab # [ 283.688836] systemd[1]: gitlab-sidekiq.service: Consumed 1min 29.050s CPU time over 3min 29.338s wall clock time, 956.4M memory peak, 4.4M read from disk.1737gitlab # [ 283.698982] systemd[1]: Started gitlab-sidekiq.service.1738gitlab # [ 283.707632] setup-gitlab-start[2228]: + mkdir -p /var/lib/secrets1739gitlab # [ 283.718639] setup-gitlab-start[2228]: + echo nixbot-test-token-of-20-chars1740gitlab # [ 283.723263] setup-gitlab-start[2228]: + chmod 644 /var/lib/secrets/gitlab-token1741gitlab # [ 283.733074] setup-gitlab-start[2228]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1742gitlab # [ 284.259976] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:15 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 5001743gitlab # [ 285.308091] gitaly[863]: time="2026-09-09T10:36:16.561Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:26.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:16.560" pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744gitlab # [ 285.330737] gitaly[863]: time="2026-09-09T10:36:16.582Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:26.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:16.560" grpc.time_ms=0.496 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 285.581697] gitaly[863]: time="2026-09-09T10:36:16.831Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:26.280" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:16.831" pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1746gitlab # [ 285.585564] gitaly[863]: time="2026-09-09T10:36:16.831Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:26.280" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:16.831" grpc.time_ms=0.382 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747gitlab # [ 285.757673] gitaly[863]: time="2026-09-09T10:36:17.011Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS diskcache=6ac8cf42-a21a-4ece-bdb8-a5f52c8d8fb2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-09T10:36:26.001" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:16.911" pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1748gitlab # [ 285.759462] gitaly[863]: time="2026-09-09T10:36:17.011Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1577 command.oublock=32 command.real_time_ms=24 command.spawn_token_fork_ms=5 command.system_time_ms=11 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-09T10:36:26.001" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:16.911" grpc.time_ms=99.783 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1749gitlab # [ 285.795561] gitaly[863]: time="2026-09-09T10:36:17.048Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:27.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.048" pid=863 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1750gitlab # [ 285.797094] gitaly[863]: time="2026-09-09T10:36:17.049Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:27.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.048" grpc.time_ms=0.865 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1751gitlab # [ 285.840783] gitaly[863]: time="2026-09-09T10:36:17.094Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=16 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:27.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.058" grpc.time_ms=34.774 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1752gitlab # [ 285.959108] gitaly[863]: time="2026-09-09T10:36:17.212Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:27.172" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.212" pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1753gitlab # [ 285.960741] gitaly[863]: time="2026-09-09T10:36:17.214Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:27.172" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.212" grpc.time_ms=1.784 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1754gitlab # [ 286.091897] gitaly[863]: time="2026-09-09T10:36:17.345Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS diskcache=4d05e490-cb6e-4754-b058-720431a6270c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-09T10:36:27.210" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.250" pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1755gitlab # [ 286.094974] gitaly[863]: time="2026-09-09T10:36:17.346Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1572 command.oublock=32 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-09T10:36:27.210" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.250" grpc.time_ms=94.891 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1756gitlab # [ 286.111795] gitaly[863]: time="2026-09-09T10:36:17.362Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:27.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.361" pid=863 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1757gitlab # [ 286.113269] gitaly[863]: time="2026-09-09T10:36:17.362Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:27.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.361" grpc.time_ms=0.653 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 286.122735] gitaly[863]: time="2026-09-09T10:36:17.376Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:27.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.368" grpc.time_ms=7.735 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 286.179841] gitaly[863]: time="2026-09-09T10:36:17.433Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:27.072" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.433" grpc.time_ms=0.233 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 286.208583] gitaly[863]: time="2026-09-09T10:36:17.462Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-09T10:36:27.100" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:17.461" grpc.time_ms=0.349 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 287.259838] gitaly[863]: time="2026-09-09T10:36:18.513Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M22VTQT4RF3N7V46A27ACQJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:28.140" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:18.501" grpc.time_ms=11.479 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 287.766143] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:19 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 34621763gitlab # [ 287.777681] setup-gitlab-start[2856]: {"id":1,"message":null,"error":null}1764gitlab # [ 292.624627] sidekiq-cluster[2840]: {"severity":"INFO","time":"2026-09-09T10:36:23.820Z","message":"Starting cluster with 1 processes"}1765gitlab # [ 293.996241] gitaly[863]: time="2026-09-09T10:36:25.249Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV03T2T0MH0YMVKS1Q275 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:35.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:25.239" grpc.time_ms=9.838 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 295.024577] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:26 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 22181767gitlab # [ 295.032324] setup-gitlab-start[2228]: + mkdir -p /tmp/test-flake1768gitlab # [ 295.039152] setup-gitlab-start[2228]: + cd /tmp/test-flake1769gitlab # [ 295.041216] setup-gitlab-start[2228]: + git init -b master1770gitlab # [ 295.067969] setup-gitlab-start[2950]: Initialized empty Git repository in /tmp/test-flake/.git/1771gitlab # [ 295.071139] setup-gitlab-start[2228]: + git config user.name test1772gitlab # [ 295.078204] setup-gitlab-start[2228]: + git config user.email test@example.com1773gitlab # [ 295.084987] setup-gitlab-start[2228]: + cat1774gitlab # [ 295.092340] setup-gitlab-start[2228]: + git add flake.nix1775gitlab # [ 295.099045] setup-gitlab-start[2228]: + git commit -m 'initial commit'1776gitlab # [ 295.129917] setup-gitlab-start[2955]: [master (root-commit) 23c0426] initial commit1777gitlab # [ 295.133288] setup-gitlab-start[2955]: 1 file changed, 10 insertions(+)1778gitlab # [ 295.133689] setup-gitlab-start[2955]: create mode 100644 flake.nix1779gitlab # [ 295.133825] setup-gitlab-start[2228]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1780gitlab # [ 295.153756] setup-gitlab-start[2228]: + git push -u origin master1781gitlab # [ 295.257280] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:26 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 701782gitlab # [ 295.476239] gitaly[863]: time="2026-09-09T10:36:26.727Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2GK3H0TN3MXK8EM1S30 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:26.714" grpc.time_ms=12.87 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1783gitlab # [ 295.479042] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:26 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2141784gitlab # [ 295.983267] gitaly[863]: time="2026-09-09T10:36:27.237Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:37.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:27.225" grpc.time_ms=10.914 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 296.069250] gitaly[863]: time="2026-09-09T10:36:27.322Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-09T10:36:57.012" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-09T10:36:27.312" grpc.time_ms=10.092 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab # [ 296.139346] gitaly[863]: time="2026-09-09T10:36:27.393Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 duration_ms=329ns method=POST pid=863 status=200 url="http://unix/api/v4/internal/allowed"1787gitlab # [ 296.214463] gitaly[863]: time="2026-09-09T10:36:27.468Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 duration_ms=69ns method=POST pid=863 status=200 url="http://unix/api/v4/internal/pre_receive"1788gitlab # [ 296.228327] gitaly[863]: time="2026-09-09T10:36:27.469Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:27.062" grpc.time_ms=407.415 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1789gitlab # [ 296.291084] gitaly[863]: time="2026-09-09T10:36:27.544Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:27.543" grpc.time_ms=1.327 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1790gitlab # [ 296.360990] gitaly[863]: time="2026-09-09T10:36:27.614Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:27.613" grpc.time_ms=1.206 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1791gitlab # [ 296.446566] gitaly[863]: time="2026-09-09T10:36:27.700Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:27.697" grpc.time_ms=1.616 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1792gitlab # [ 296.611322] gitaly[863]: time="2026-09-09T10:36:27.864Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:37.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:27.854" grpc.time_ms=9.664 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 296.654397] gitaly[863]: time="2026-09-09T10:36:27.908Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1569 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=9 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-09T10:36:37.026" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:27.877" grpc.time_ms=30.251 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794gitlab # [ 296.684595] gitaly[863]: time="2026-09-09T10:36:27.938Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 duration_ms=186ns method=POST pid=863 status=200 url="http://unix/api/v4/internal/post_receive"1795gitlab # [ 296.688972] gitaly[863]: time="2026-09-09T10:36:27.942Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:27.751" grpc.time_ms=191.428 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1796gitlab # [ 296.714649] gitaly[863]: time="2026-09-09T10:36:27.967Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 diskcache=dee581ce-0dd0-461d-8ca1-828c837d800e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:26.971" pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1797gitlab # [ 296.715966] gitaly[863]: time="2026-09-09T10:36:27.968Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=279 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13442 command.oublock=32 command.real_time_ms=984 command.spawn_token_fork_ms=2 command.system_time_ms=180 command.user_time_ms=99 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:26.971" grpc.time_ms=996.13 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1798gitlab # [ 296.750102] gitlab-workhorse[823]: time="2026-09-09T10:36:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521799gitlab # [ 296.755116] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:28 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 12101800gitlab # [ 296.761965] setup-gitlab-start[2959]: To http://gitlab/root/test-flake.git1801gitlab # [ 296.763111] setup-gitlab-start[2959]: * [new branch] master -> master1802gitlab # [ 296.770962] setup-gitlab-start[2959]: branch 'master' set up to track 'origin/master'.1803gitlab # [ 296.774621] systemd[1]: Finished setup-gitlab.service.1804gitlab # [ 296.784443] systemd[1]: Starting nixbot CI service...1805gitlab: (finished: waiting for unit setup-gitlab.service, in 298.44 seconds)1806gitlab: waiting for unit nixbot.service1807gitlab # [ 298.895288] nixbot[3042]: {"ts": "2026-09-09T10:36:30.145Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1808gitlab # [ 298.945503] nixbot[3042]: {"ts": "2026-09-09T10:36:30.198Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1809gitlab # [ 298.976520] nixbot[3042]: {"ts": "2026-09-09T10:36:30.229Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1810gitlab # [ 298.987700] nixbot[3042]: {"ts": "2026-09-09T10:36:30.240Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1811gitlab # [ 299.009234] nixbot[3042]: {"ts": "2026-09-09T10:36:30.262Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1812gitlab # [ 299.023929] nixbot[3042]: {"ts": "2026-09-09T10:36:30.277Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1813gitlab # [ 299.031673] nixbot[3042]: {"ts": "2026-09-09T10:36:30.285Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1814gitlab # [ 299.038530] nixbot[3042]: {"ts": "2026-09-09T10:36:30.292Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1815gitlab # [ 299.052678] nixbot[3042]: {"ts": "2026-09-09T10:36:30.306Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1816gitlab # [ 299.058786] nixbot[3042]: {"ts": "2026-09-09T10:36:30.312Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1817gitlab # [ 299.069362] nixbot[3042]: {"ts": "2026-09-09T10:36:30.322Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1818gitlab # [ 299.085220] nixbot[3042]: {"ts": "2026-09-09T10:36:30.338Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1819gitlab # [ 299.096792] nixbot[3042]: {"ts": "2026-09-09T10:36:30.350Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1820gitlab # [ 299.101924] nixbot[3042]: {"ts": "2026-09-09T10:36:30.355Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1821gitlab # [ 299.110091] nixbot[3042]: {"ts": "2026-09-09T10:36:30.363Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1822gitlab # [ 299.115290] nixbot[3042]: {"ts": "2026-09-09T10:36:30.368Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1823gitlab # [ 299.119990] nixbot[3042]: {"ts": "2026-09-09T10:36:30.373Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1824gitlab # [ 299.128897] nixbot[3042]: {"ts": "2026-09-09T10:36:30.382Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1825gitlab # [ 299.140445] nixbot[3042]: {"ts": "2026-09-09T10:36:30.393Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1826gitlab # [ 299.146805] nixbot[3042]: {"ts": "2026-09-09T10:36:30.400Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1827gitlab # [ 299.153987] nixbot[3042]: {"ts": "2026-09-09T10:36:30.407Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1828gitlab # [ 299.166827] nixbot[3042]: {"ts": "2026-09-09T10:36:30.420Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1829gitlab # [ 299.173521] nixbot[3042]: {"ts": "2026-09-09T10:36:30.427Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1830gitlab # [ 299.181335] nixbot[3042]: {"ts": "2026-09-09T10:36:30.434Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1831gitlab # [ 299.187814] nixbot[3042]: {"ts": "2026-09-09T10:36:30.441Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1832gitlab # [ 299.196753] nixbot[3042]: {"ts": "2026-09-09T10:36:30.450Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1833gitlab # [ 299.203341] nixbot[3042]: {"ts": "2026-09-09T10:36:30.456Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1834gitlab # [ 299.210103] nixbot[3042]: {"ts": "2026-09-09T10:36:30.463Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1835gitlab # [ 299.223860] nixbot[3042]: {"ts": "2026-09-09T10:36:30.477Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1836gitlab # [ 299.251785] nixbot[3042]: {"ts": "2026-09-09T10:36:30.505Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1837gitlab # [ 299.261746] nixbot[3042]: {"ts": "2026-09-09T10:36:30.515Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1838gitlab # [ 299.266361] nixbot[3042]: {"ts": "2026-09-09T10:36:30.519Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1839gitlab # [ 299.274305] nixbot[3042]: {"ts": "2026-09-09T10:36:30.527Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1840gitlab # [ 299.289777] nixbot[3042]: {"ts": "2026-09-09T10:36:30.543Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1841gitlab # [ 299.855760] nixbot[3042]: INFO: Started server process [3042]1842gitlab # [ 299.856729] nixbot[3042]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1843gitlab # [ 299.921582] nixbot[3042]: INFO: ::ffff:127.0.0.1:39018 - "GET /health HTTP/1.1" 200 OK1844gitlab # [ 299.934363] systemd[1]: Started nixbot CI service.1845gitlab # [ 299.938993] systemd[1]: Reached target Multi-User System.1846gitlab # [ 299.941106] systemd[1]: Startup finished in 1.244s (kernel) + 3.535s (initrd) + 4min 55.160s (userspace) = 4min 59.940s.1847gitlab: (finished: waiting for unit nixbot.service, in 2.20 seconds)1848gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1849gitlab # [ 299.999632] nixbot[3042]: INFO: ::ffff:127.0.0.1:39020 - "GET /health HTTP/1.1" 200 OK1850gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1851subtest: project discovered and webhook registered1852gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1853gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds)1854gitlab # [ 300.193430] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1401855gitlab # [ 300.464883] nixbot[3042]: {"ts": "2026-09-09T10:36:31.717Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1856gitlab # [ 300.472774] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:31 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 5411857gitlab # [ 300.512115] nixbot[3042]: {"ts": "2026-09-09T10:36:31.759Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1858gitlab # [ 300.622195] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 911859gitlab # [ 300.622818] nixbot[3042]: {"ts": "2026-09-09T10:36:31.875Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1860gitlab # [ 300.627393] nixbot[3042]: {"ts": "2026-09-09T10:36:31.881Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1861gitlab # [ 300.838642] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:32 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 2061862gitlab # [ 300.843964] nixbot[3042]: {"ts": "2026-09-09T10:36:32.093Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1863gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1864gitlab # [ 301.333882] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 1071865gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.15 seconds)1866(finished: subtest: project discovered and webhook registered, in 1.34 seconds)1867subtest: push delivers the webhook1868gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1869gitlab # [ 301.440134] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:32 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 5901870gitlab # [ 301.442192] nixbot[3042]: {"ts": "2026-09-09T10:36:32.695Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1871gitlab # [ 301.615346] nixbot[3042]: {"ts": "2026-09-09T10:36:32.868Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1872gitlab # [ 301.616263] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 1581873gitlab # [ 301.768973] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:33 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 1471874gitlab # [ 301.777251] nixbot[3042]: {"ts": "2026-09-09T10:36:33.030Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1875gitlab # [ 301.905303] gitaly[863]: time="2026-09-09T10:36:33.157Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=10 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV8WGVR6YGNQA4ACBM1TQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-09T10:37:03.035" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:33.135" grpc.time_ms=20.884 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 301.934690] gitaly[863]: time="2026-09-09T10:36:33.188Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV8WGVR6YGNQA4ACBM1TQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:03.085" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:33.186" grpc.time_ms=1.156 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 301.954241] gitaly[863]: time="2026-09-09T10:36:33.204Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV8WGVR6YGNQA4ACBM1TQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-09T10:36:43.003" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:33.194" grpc.time_ms=9.534 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 302.025738] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2381879gitlab # [ 302.029096] nixbot[3042]: {"ts": "2026-09-09T10:36:33.281Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1880gitlab # [ 302.223933] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1811881gitlab # [ 302.228315] nixbot[3042]: {"ts": "2026-09-09T10:36:33.481Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1882gitlab # [ 302.236448] nixbot[3042]: {"ts": "2026-09-09T10:36:33.490Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1883gitlab # [ 302.401579] gitaly[863]: time="2026-09-09T10:36:33.654Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=13 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M22VV9CJ4JRMZK00DTWQ70C3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:33.634" grpc.time_ms=20.042 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1884gitlab # [ 302.435741] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:33 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1331885gitlab # [ 302.630414] gitaly[863]: time="2026-09-09T10:36:33.884Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV9GZEWX0J0HNQDB811A3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:33.861" pid=863 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1886gitlab # [ 302.662983] gitaly[863]: time="2026-09-09T10:36:33.884Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=10 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV9GZEWX0J0HNQDB811A3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:33.861" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1887gitlab # [ 302.684384] gitlab-workhorse[823]: time="2026-09-09T10:36:33Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131888gitlab # [ 302.687307] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:33 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 2161889gitlab # [ 302.690763] gitaly[863]: time="2026-09-09T10:36:33.911Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=10 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV9GZEWX0J0HNQDB811A3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:33.861" grpc.time_ms=48.694 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1890gitlab # [ 302.889935] gitaly[863]: time="2026-09-09T10:36:34.142Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV9RPHHTJ8Q1T1JV74SCE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:34.114" pid=863 remote_ip="2001:db8:1::1" request_sha=f3c2b7da4647e9612fcde51f788c7cda9052296a response_bytes=224 span.kind=server system=grpc1891gitlab # [ 302.890505] gitlab-workhorse[823]: time="2026-09-09T10:36:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2241892gitlab # [ 302.890669] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 2001893gitlab # [ 302.890789] gitaly[863]: time="2026-09-09T10:36:34.142Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV9RPHHTJ8Q1T1JV74SCE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:34.114" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1894gitlab # [ 302.890928] gitaly[863]: time="2026-09-09T10:36:34.142Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV9RPHHTJ8Q1T1JV74SCE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:34.114" grpc.time_ms=27.82 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1895gitlab # [ 303.333481] gitaly[863]: time="2026-09-09T10:36:34.586Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M22VVA31CE8P213H28MPGT73 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:34.574" grpc.time_ms=11.698 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1896gitlab # [ 303.365801] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 3461897gitlab # [ 303.508796] gitaly[863]: time="2026-09-09T10:36:34.761Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVADYA1XD262HQ5CMEJGY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:34.720" pid=863 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1898gitlab # [ 303.510566] gitaly[863]: time="2026-09-09T10:36:34.761Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=16 command.system_time_ms=1 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVADYA1XD262HQ5CMEJGY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:34.720" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1899gitlab # [ 303.513448] gitlab-workhorse[823]: time="2026-09-09T10:36:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671900gitlab # [ 303.514399] gitaly[863]: time="2026-09-09T10:36:34.762Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=16 command.system_time_ms=1 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVADYA1XD262HQ5CMEJGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:34.720" grpc.time_ms=41.167 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1901gitlab # [ 303.576651] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1391902gitlab # [ 303.747162] gitaly[863]: time="2026-09-09T10:36:35.000Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22VVAP4Q6MFZD30E7KY940K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:34.985" grpc.time_ms=14.739 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1903gitlab # [ 303.772494] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1401904gitlab # [ 303.933212] gitaly[863]: time="2026-09-09T10:36:35.186Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVATW8AF1556K0VJPSQH7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:35.153" pid=863 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1905gitlab # [ 303.950420] gitaly[863]: time="2026-09-09T10:36:35.203Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=13 command.system_time_ms=10 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVATW8AF1556K0VJPSQH7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:35.153" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1906gitlab # [ 303.979524] gitaly[863]: time="2026-09-09T10:36:35.204Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=13 command.system_time_ms=10 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVATW8AF1556K0VJPSQH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:35.153" grpc.time_ms=50.431 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1907gitlab # [ 304.005355] gitlab-workhorse[823]: time="2026-09-09T10:36:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091908gitlab # [ 304.009589] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1691909gitlab # [ 304.209912] gitaly[863]: time="2026-09-09T10:36:35.463Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:05.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:35.462" grpc.time_ms=0.922 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1910gitlab # [ 304.271913] gitaly[863]: time="2026-09-09T10:36:35.525Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-09T10:37:05.113" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:35.514" grpc.time_ms=10.889 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1911gitlab # [ 304.321865] gitaly[863]: time="2026-09-09T10:36:35.575Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:36:45.202" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:35.563" grpc.time_ms=11.772 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1912gitlab # [ 304.379343] gitaly[863]: time="2026-09-09T10:36:35.632Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:36:45.259" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:35.619" grpc.time_ms=12.708 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1913gitlab # [ 304.534569] gitaly[863]: time="2026-09-09T10:36:35.788Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-09T10:36:45.005" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:35.787" grpc.time_ms=0.482 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1914gitlab # [ 304.580220] gitaly[863]: time="2026-09-09T10:36:35.834Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-09T10:36:45.034" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:35.814" grpc.time_ms=18.484 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1915gitlab # [ 304.651350] gitaly[863]: time="2026-09-09T10:36:35.905Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:35.904" grpc.time_ms=0.675 pid=863 span.kind=server system=grpc1916gitlab # [ 304.735576] gitaly[863]: time="2026-09-09T10:36:35.989Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:35.986" grpc.time_ms=3.05 pid=863 span.kind=server system=grpc1917gitlab # [ 304.812578] gitaly[863]: time="2026-09-09T10:36:36.065Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM diskcache=59e7b9f7-354d-485f-9258-011fe7213031 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:36:45.058" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:35.839" pid=863 ref=refs/keep-around/23c0426c7d7244e6daf15e71d94c768e8374df0e remote_ip="2001:db8:1::1" revision=23c0426c7d7244e6daf15e71d94c768e8374df0e span.kind=server system=grpc username=root1918gitlab # [ 304.821858] gitaly[863]: time="2026-09-09T10:36:36.072Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=128 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5212 command.oublock=8 command.real_time_ms=172 command.spawn_token_fork_ms=5 command.system_time_ms=92 command.user_time_ms=36 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:36:45.058" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:35.839" grpc.time_ms=226.133 pid=863 ref=refs/keep-around/23c0426c7d7244e6daf15e71d94c768e8374df0e remote_ip="2001:db8:1::1" revision=23c0426c7d7244e6daf15e71d94c768e8374df0e span.kind=server system=grpc username=root1919gitlab # [ 304.892301] gitaly[863]: time="2026-09-09T10:36:36.144Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:06.137" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:36.138" grpc.time_ms=5.95 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1920gitlab # [ 305.245361] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 11551921gitlab # [ 305.253695] nixbot[3042]: {"ts": "2026-09-09T10:36:36.506Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e \"HTTP/1.1 201 Created\""}1922gitlab # [ 305.270754] nixbot[3042]: {"ts": "2026-09-09T10:36:36.523Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-23c0426c7d72-0"}1923gitlab # [ 305.485218] nixbot[3042]: {"ts": "2026-09-09T10:36:36.738Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-23c0426c7d72-0", "argv0": "bwrap"}1924gitlab # [ 305.609326] systemd[1]: Started Nix Daemon.1925gitlab # [ 305.670680] nix-daemon[3220]: accepted connection from pid 3208, user nixbot1926gitlab # [ 308.753543] redis[787]: 10 changes in 300 seconds. Saving...1927gitlab # [ 308.773483] redis[787]: Background saving started by pid 32521928gitlab # [ 308.778786] redis[3252]: BGSAVE done, 510 keys saved, 0 keys skipped, 128368 bytes written.1929gitlab # [ 308.782326] redis[3252]: DB saved on disk1930gitlab # [ 308.783269] redis[3252]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1931gitlab # [ 308.854827] redis[787]: Background saving terminated with success1932gitlab # [ 310.427292] gitaly[863]: time="2026-09-09T10:36:41.680Z" level=info msg="burden monitor stats" pid=8631933gitlab # [ 310.537932] nix-daemon[3220]: accepted connection from pid 3262, user nixbot1934gitlab # [ 310.577386] nix-daemon[3220]: accepted connection from pid 3208, user nixbot1935gitlab # [ 310.725546] postgres[891]: [891] LOG: checkpoint starting: time1936gitlab # [ 315.017473] nix-daemon[3220]: accepted connection from pid 3208, user nixbot1937gitlab # [ 315.176356] nix-daemon[3220]: accepted connection from pid 3311, user nixbot1938gitlab # [ 315.278353] gitaly[863]: time="2026-09-09T10:36:46.531Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVNYP0CTPCWT4KQNRTYN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:16.223" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:46.524" grpc.time_ms=6.95 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 315.737307] gitaly[863]: time="2026-09-09T10:36:46.990Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22VVNYP0CTPCWT4KQNRTYN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:36:56.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:46.979" grpc.time_ms=11.06 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab # [ 316.049535] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 8791941gitlab # [ 316.050546] nixbot[3042]: {"ts": "2026-09-09T10:36:47.303Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e \"HTTP/1.1 201 Created\""}1942gitlab # [ 316.191794] gitaly[863]: time="2026-09-09T10:36:47.445Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVPTC0BAH6NHZCTAQ7HD8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:17.140" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:47.441" grpc.time_ms=3.863 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943gitlab # [ 316.271738] gitaly[863]: time="2026-09-09T10:36:47.525Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=9 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVPTC0BAH6NHZCTAQ7HD8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:36:57.292" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:47.513" grpc.time_ms=11.533 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1944gitlab # [ 316.460908] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 4051945gitlab # [ 316.465815] nixbot[3042]: {"ts": "2026-09-09T10:36:47.719Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e \"HTTP/1.1 201 Created\""}1946gitlab # [ 319.822762] nix-daemon[3220]: accepted connection from pid 3367, user nixbot1947gitlab # [ 320.071455] gitaly[863]: time="2026-09-09T10:36:51.324Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVTKBB7MMTC3M5EW54KMZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:21.023" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:51.323" grpc.time_ms=0.812 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 320.144593] gitaly[863]: time="2026-09-09T10:36:51.398Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M22VVTKBB7MMTC3M5EW54KMZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:37:01.166" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:51.386" grpc.time_ms=11.232 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 320.304555] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3781950gitlab # [ 320.307903] nixbot[3042]: {"ts": "2026-09-09T10:36:51.559Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e \"HTTP/1.1 201 Created\""}1951gitlab # [ 320.839228] gitaly[863]: time="2026-09-09T10:36:52.090Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=10 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22VVVC6R8EVA8ZQFC1SQKQY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:52.071" grpc.time_ms=18.83 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1952gitlab # [ 320.840370] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1171953gitlab # [ 321.030413] gitaly[863]: time="2026-09-09T10:36:52.284Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVVGWZEBKWQX281BPCM2C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:52.271" pid=863 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1954gitlab # [ 321.047501] gitaly[863]: time="2026-09-09T10:36:52.301Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVVGWZEBKWQX281BPCM2C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:52.271" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1955gitlab # [ 321.077741] gitaly[863]: time="2026-09-09T10:36:52.323Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVVGWZEBKWQX281BPCM2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:52.271" grpc.time_ms=51.778 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1956gitlab # [ 321.078865] gitlab-workhorse[823]: time="2026-09-09T10:36:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671957gitlab # [ 321.079759] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1991958gitlab # [ 321.282762] gitaly[863]: time="2026-09-09T10:36:52.531Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=9 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M22VVVSSZ84D8A19E28WXQQA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:52.502" grpc.time_ms=28.73 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1959gitlab # [ 321.320713] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1231960gitlab # [ 321.449884] gitaly[863]: time="2026-09-09T10:36:52.703Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVVXV87CQFWP572CN54AB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:52.682" pid=863 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1961gitlab # [ 321.465433] gitaly[863]: time="2026-09-09T10:36:52.703Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=8 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVVXV87CQFWP572CN54AB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:52.682" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1962gitlab # [ 321.492352] gitlab-workhorse[823]: time="2026-09-09T10:36:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671963gitlab # [ 321.495716] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1661964gitlab # [ 321.499364] gitaly[863]: time="2026-09-09T10:36:52.706Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=8 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVVXV87CQFWP572CN54AB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:52.682" grpc.time_ms=21.979 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc1965gitlab # [ 373.592508] sidekiq-cluster[2922]: 2026-09-09T10:37:44.843Z pid=2922 tid=xj6 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2922, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>440844288}1966gitlab # [ 374.211236] sidekiq-cluster[2922]: W, [2026-09-09T10:37:45.464764 #2922] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1967gitlab # [ 374.320375] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:37:45.573Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1968gitlab # [ 378.636381] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:37:49.889Z","message":"GitLab reliable fetch activated!"}1969gitlab # [ 378.637872] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:37:49.889Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1970gitlab # [ 436.833211] postgres[4244]: [4244] ERROR: relation "table_without_models" does not exist1971gitlab # [ 436.839563] postgres[4244]: [4244] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1972gitlab # [ 442.813592] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:54.066Z","message":"Booted Rails 7.2.3.1 application in production environment"}1973gitlab # [ 442.820572] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:54.074Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1974gitlab # [ 442.822290] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:54.075Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1975gitlab # [ 442.827733] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:54.081Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1976gitlab # [ 442.835354] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:54.088Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1977gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 141.80 seconds)1978gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1979gitlab # [ 443.312547] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1061980gitlab # [ 443.490598] gitaly[863]: time="2026-09-09T10:38:54.742Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VZK3E2VGYW8PSMQPJZA2M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:54.727" grpc.time_ms=15.189 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1981gitlab # [ 443.491916] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1681982gitlab # Enumerating objects: 5, done.1983gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1984gitlab # Delta compression using up to 4 threads1985gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1986gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1987gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1988gitlab # [ 443.971873] gitaly[863]: time="2026-09-09T10:38:55.225Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=326 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-09T10:39:25.112" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-09T10:38:55.213" grpc.time_ms=12.071 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1989gitlab # [ 444.009140] gitaly[863]: time="2026-09-09T10:38:55.261Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M22VZKAQ14VTF170BVKAY02W duration_ms=188ns method=POST pid=863 status=200 url="http://unix/api/v4/internal/allowed"1990gitlab # [ 444.139144] gitaly[863]: time="2026-09-09T10:38:55.392Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M22VZKAQ14VTF170BVKAY02W duration_ms=130ns method=POST pid=863 status=200 url="http://unix/api/v4/internal/pre_receive"1991gitlab # [ 444.147535] gitaly[863]: time="2026-09-09T10:38:55.401Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:55.072" grpc.time_ms=320.867 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1992gitlab # [ 444.264556] gitaly[863]: time="2026-09-09T10:38:55.518Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:55.501" grpc.time_ms=16.528 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1993gitlab # [ 444.364114] gitaly[863]: time="2026-09-09T10:38:55.617Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:55.617" grpc.time_ms=0.687 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1994gitlab # [ 444.430085] gitaly[863]: time="2026-09-09T10:38:55.683Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:55.683" grpc.time_ms=0.682 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1995gitlab # [ 444.720642] gitaly[863]: time="2026-09-09T10:38:55.973Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M22VZKAQ14VTF170BVKAY02W duration_ms=180ns method=POST pid=863 status=200 url="http://unix/api/v4/internal/post_receive"1996gitlab # [ 444.721330] gitaly[863]: time="2026-09-09T10:38:55.974Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:55.792" grpc.time_ms=182.013 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1997gitlab # [ 444.787724] gitaly[863]: time="2026-09-09T10:38:56.040Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W diskcache=e93a8afb-49ec-464e-a746-5e0888fdd1a4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:54.973" pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1998gitlab # [ 444.808346] gitaly[863]: time="2026-09-09T10:38:56.041Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=361 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13822 command.oublock=32 command.real_time_ms=1024 command.spawn_token_fork_ms=1 command.system_time_ms=243 command.user_time_ms=118 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:54.973" grpc.time_ms=1067.73 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1999gitlab # To http://gitlab/root/test-flake.git2000gitlab # 23c0426..31a0e91 master -> master2001gitlab # [ 444.843767] gitlab-workhorse[823]: time="2026-09-09T10:38:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=522002gitlab # [ 444.846730] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:56 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 12342003gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.76 seconds)2004gitlab: must succeed: git -C /tmp/test-flake rev-parse master2005gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)2006gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2007gitlab # [ 445.083550] nixbot[3042]: INFO: ::ffff:127.0.0.1:58446 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2008gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.17 seconds)2009gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2010gitlab # [ 446.137291] nixbot[3042]: INFO: ::ffff:127.0.0.1:58448 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2011gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.05 seconds)2012gitlab # [ 446.588501] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:57.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc796e4f1a50d67e4f582d67","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc796e4f1a50d67e4f582d67: start","job_status":"start","queue_duration_s":166.718667,"scheduling_latency_s":166.71874}2013gitlab # [ 446.758859] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc796e4f1a50d67e4f582d67","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc796e4f1a50d67e4f582d67: done: 0.172517 sec","job_status":"done","queue_duration_s":166.718667,"scheduling_latency_s":166.71874,"redis_calls":28,"redis_duration_s":0.024858,"redis_read_bytes":1422,"redis_write_bytes":2485,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.018897,"redis_feature_flag_read_bytes":1412,"redis_feature_flag_write_bytes":1328,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002668,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003293,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.172517,"completed_at":"2026-09-09T10:38:58.011Z","load_balancing_strategy":"primary","db_duration_s":0.007505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2014gitlab # [ 446.765737] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af739fe2c17c830420ac610a","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af739fe2c17c830420ac610a: start","job_status":"start","queue_duration_s":166.895805,"scheduling_latency_s":166.89585}2015gitlab # [ 446.818340] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af739fe2c17c830420ac610a","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af739fe2c17c830420ac610a: done: 0.054977 sec","job_status":"done","queue_duration_s":166.895805,"scheduling_latency_s":166.89585,"redis_calls":13,"redis_duration_s":0.013729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008414,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005315,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.054977,"completed_at":"2026-09-09T10:38:58.071Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2016gitlab # [ 446.886567] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc3e655f4c9d6b321b428660","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc3e655f4c9d6b321b428660: start","job_status":"start","queue_duration_s":166.956653,"scheduling_latency_s":166.956709}2017gitlab # [ 446.891110] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc3e655f4c9d6b321b428660","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc3e655f4c9d6b321b428660: done: 0.041539 sec","job_status":"done","queue_duration_s":166.956653,"scheduling_latency_s":166.956709,"redis_calls":13,"redis_duration_s":0.010424000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003801,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006623,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041539,"completed_at":"2026-09-09T10:38:58.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2018gitlab # [ 446.954711] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7fede9ab9b3b87c4765f193","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7fede9ab9b3b87c4765f193: start","job_status":"start","queue_duration_s":167.004313,"scheduling_latency_s":167.004371}2019gitlab # [ 446.956637] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7fede9ab9b3b87c4765f193","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7fede9ab9b3b87c4765f193: done: 0.044744 sec","job_status":"done","queue_duration_s":167.004313,"scheduling_latency_s":167.004371,"redis_calls":13,"redis_duration_s":0.011668999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044744,"completed_at":"2026-09-09T10:38:58.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2020gitlab # [ 446.982287] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82f2f285870719a1b921fe0f","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82f2f285870719a1b921fe0f: start","job_status":"start","queue_duration_s":167.054042,"scheduling_latency_s":167.054096}2021gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2022gitlab # [ 447.054980] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82f2f285870719a1b921fe0f","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82f2f285870719a1b921fe0f: done: 0.048613 sec","job_status":"done","queue_duration_s":167.054042,"scheduling_latency_s":167.054096,"redis_calls":13,"redis_duration_s":0.011876000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006819,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.048613,"completed_at":"2026-09-09T10:38:58.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2023gitlab # [ 447.165406] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79680192157c03b7491e71f5","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79680192157c03b7491e71f5: start","job_status":"start","queue_duration_s":167.106023,"scheduling_latency_s":167.106078}2024gitlab # [ 447.171578] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79680192157c03b7491e71f5","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79680192157c03b7491e71f5: done: 0.034183 sec","job_status":"done","queue_duration_s":167.106023,"scheduling_latency_s":167.106078,"redis_calls":13,"redis_duration_s":0.005449000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00168,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034183,"completed_at":"2026-09-09T10:38:58.260Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 447.247470] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa51b48a54d9289c90818fbf","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa51b48a54d9289c90818fbf: start","job_status":"start","queue_duration_s":167.143557,"scheduling_latency_s":167.143609}2026gitlab # [ 447.249133] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa51b48a54d9289c90818fbf","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa51b48a54d9289c90818fbf: done: 0.033379 sec","job_status":"done","queue_duration_s":167.143557,"scheduling_latency_s":167.143609,"redis_calls":13,"redis_duration_s":0.006203,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004386,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033379,"completed_at":"2026-09-09T10:38:58.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2027gitlab # [ 447.329236] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b1c2d0668de4d82271b5d0c","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b1c2d0668de4d82271b5d0c: start","job_status":"start","queue_duration_s":167.182967,"scheduling_latency_s":167.183033}2028gitlab # [ 447.331148] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b1c2d0668de4d82271b5d0c","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b1c2d0668de4d82271b5d0c: done: 0.05268 sec","job_status":"done","queue_duration_s":167.182967,"scheduling_latency_s":167.183033,"redis_calls":13,"redis_duration_s":0.014221000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004819,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009402,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.05268,"completed_at":"2026-09-09T10:38:58.356Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2029gitlab # [ 447.399998] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6b7bb4d35d101d0dec1e6f2","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6b7bb4d35d101d0dec1e6f2: start","job_status":"start","queue_duration_s":167.240945,"scheduling_latency_s":167.240992}2030gitlab # [ 447.400901] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6b7bb4d35d101d0dec1e6f2","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6b7bb4d35d101d0dec1e6f2: done: 0.045293 sec","job_status":"done","queue_duration_s":167.240945,"scheduling_latency_s":167.240992,"redis_calls":13,"redis_duration_s":0.014837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005424,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009413,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045293,"completed_at":"2026-09-09T10:38:58.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2031gitlab # [ 447.492428] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1e36ebd8bed004bed31d2ef","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1e36ebd8bed004bed31d2ef: start","job_status":"start","queue_duration_s":167.291819,"scheduling_latency_s":167.291888}2032gitlab # [ 447.494069] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1e36ebd8bed004bed31d2ef","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1e36ebd8bed004bed31d2ef: done: 0.039848 sec","job_status":"done","queue_duration_s":167.291819,"scheduling_latency_s":167.291888,"redis_calls":13,"redis_duration_s":0.008577999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002169,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006409,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039848,"completed_at":"2026-09-09T10:38:58.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2033gitlab # [ 447.584157] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ee42ec221d65efdf01308f7","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ee42ec221d65efdf01308f7: start","job_status":"start","queue_duration_s":167.338042,"scheduling_latency_s":167.338097}2034gitlab # [ 447.585509] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ee42ec221d65efdf01308f7","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ee42ec221d65efdf01308f7: done: 0.060386 sec","job_status":"done","queue_duration_s":167.338042,"scheduling_latency_s":167.338097,"redis_calls":13,"redis_duration_s":0.023945,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.012952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060386,"completed_at":"2026-09-09T10:38:58.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2035gitlab # [ 447.618047] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0a10b8f9d31682d02088819","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0a10b8f9d31682d02088819: start","job_status":"start","queue_duration_s":167.402239,"scheduling_latency_s":167.402479}2036gitlab # [ 447.696284] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0a10b8f9d31682d02088819","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0a10b8f9d31682d02088819: done: 0.070072 sec","job_status":"done","queue_duration_s":167.402239,"scheduling_latency_s":167.402479,"redis_calls":13,"redis_duration_s":0.014211,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006619,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.070072,"completed_at":"2026-09-09T10:38:58.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2037gitlab # [ 447.699288] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ead42b2bc89a3f97836ee951","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ead42b2bc89a3f97836ee951: start","job_status":"start","queue_duration_s":167.48012,"scheduling_latency_s":167.480182}2038gitlab # [ 447.765163] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ead42b2bc89a3f97836ee951","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ead42b2bc89a3f97836ee951: done: 0.052259 sec","job_status":"done","queue_duration_s":167.48012,"scheduling_latency_s":167.480182,"redis_calls":13,"redis_duration_s":0.016101999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.013524,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.052259,"completed_at":"2026-09-09T10:38:58.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2039gitlab # [ 447.769436] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f9dc3da0c4a2de12de77ce4","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f9dc3da0c4a2de12de77ce4: start","job_status":"start","queue_duration_s":167.538486,"scheduling_latency_s":167.538541}2040gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.72 seconds)2041gitlab # [ 447.834178] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f9dc3da0c4a2de12de77ce4","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f9dc3da0c4a2de12de77ce4: done: 0.044645 sec","job_status":"done","queue_duration_s":167.538486,"scheduling_latency_s":167.538541,"redis_calls":13,"redis_duration_s":0.012785,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009236,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044645,"completed_at":"2026-09-09T10:38:58.703Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2042gitlab # [ 447.842310] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d18d7ce40ecf4f31c2e2712","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d18d7ce40ecf4f31c2e2712: start","job_status":"start","queue_duration_s":167.586431,"scheduling_latency_s":167.58648}2043gitlab # [ 447.927880] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d18d7ce40ecf4f31c2e2712","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d18d7ce40ecf4f31c2e2712: done: 0.033865 sec","job_status":"done","queue_duration_s":167.586431,"scheduling_latency_s":167.58648,"redis_calls":13,"redis_duration_s":0.007594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004535,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033865,"completed_at":"2026-09-09T10:38:58.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2044gitlab # [ 447.929980] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d98c8287190ecf786ea31ff4","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d98c8287190ecf786ea31ff4: start","job_status":"start","queue_duration_s":167.62377,"scheduling_latency_s":167.623814}2045gitlab # [ 448.006739] nixbot[3042]: INFO: ::ffff:127.0.0.1:58460 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2046gitlab # [ 448.007981] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d98c8287190ecf786ea31ff4","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d98c8287190ecf786ea31ff4: done: 0.048794 sec","job_status":"done","queue_duration_s":167.62377,"scheduling_latency_s":167.623814,"redis_calls":13,"redis_duration_s":0.017548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008207,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009341,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.048794,"completed_at":"2026-09-09T10:38:58.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2047gitlab # [ 448.009789] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb70b6ef4b53a335e05bf5bf","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb70b6ef4b53a335e05bf5bf: start","job_status":"start","queue_duration_s":167.676659,"scheduling_latency_s":167.676729}2048gitlab # [ 448.085628] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb70b6ef4b53a335e05bf5bf","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb70b6ef4b53a335e05bf5bf: done: 0.029935 sec","job_status":"done","queue_duration_s":167.676659,"scheduling_latency_s":167.676729,"redis_calls":13,"redis_duration_s":0.005237,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003668,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029935,"completed_at":"2026-09-09T10:38:58.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2049gitlab # [ 448.089947] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4d78bfef431977bde0be668","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4d78bfef431977bde0be668: start","job_status":"start","queue_duration_s":167.70939,"scheduling_latency_s":167.709433}2050gitlab # [ 448.171992] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4d78bfef431977bde0be668","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4d78bfef431977bde0be668: done: 0.060466 sec","job_status":"done","queue_duration_s":167.70939,"scheduling_latency_s":167.709433,"redis_calls":13,"redis_duration_s":0.025307,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004386,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.020921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060466,"completed_at":"2026-09-09T10:38:58.890Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2051gitlab # [ 448.174042] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbe8164f7dd1a00569c7c17f","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbe8164f7dd1a00569c7c17f: start","job_status":"start","queue_duration_s":167.774054,"scheduling_latency_s":167.774111}2052gitlab # [ 448.232674] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbe8164f7dd1a00569c7c17f","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbe8164f7dd1a00569c7c17f: done: 0.032561 sec","job_status":"done","queue_duration_s":167.774054,"scheduling_latency_s":167.774111,"redis_calls":13,"redis_duration_s":0.008187999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006337,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032561,"completed_at":"2026-09-09T10:38:58.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2053gitlab # [ 448.235544] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"623825fdc8597c797df25502","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-623825fdc8597c797df25502: start","job_status":"start","queue_duration_s":167.808894,"scheduling_latency_s":167.808933}2054gitlab # [ 448.296660] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"623825fdc8597c797df25502","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-623825fdc8597c797df25502: done: 0.035827 sec","job_status":"done","queue_duration_s":167.808894,"scheduling_latency_s":167.808933,"redis_calls":13,"redis_duration_s":0.013979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008205,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005774,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035827,"completed_at":"2026-09-09T10:38:58.965Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2055gitlab # [ 448.303441] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cfe1795b3d2ce07d8dff140","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cfe1795b3d2ce07d8dff140: start","job_status":"start","queue_duration_s":167.847701,"scheduling_latency_s":167.847736}2056gitlab # [ 448.321397] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:58.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cfe1795b3d2ce07d8dff140","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cfe1795b3d2ce07d8dff140: done: 0.030665 sec","job_status":"done","queue_duration_s":167.847701,"scheduling_latency_s":167.847736,"redis_calls":13,"redis_duration_s":0.0047729999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001791,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030665,"completed_at":"2026-09-09T10:38:58.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2057gitlab # [ 448.387597] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5139614924a009a51fdab006","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5139614924a009a51fdab006: start","job_status":"start","queue_duration_s":167.881235,"scheduling_latency_s":167.881316}2058gitlab # [ 448.390202] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5139614924a009a51fdab006","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5139614924a009a51fdab006: done: 0.025993 sec","job_status":"done","queue_duration_s":167.881235,"scheduling_latency_s":167.881316,"redis_calls":13,"redis_duration_s":0.004096,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002482,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025993,"completed_at":"2026-09-09T10:38:59.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2059gitlab # [ 448.468321] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a276048f05636c3a00ed4a2","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a276048f05636c3a00ed4a2: start","job_status":"start","queue_duration_s":167.910152,"scheduling_latency_s":167.910196}2060gitlab # [ 448.471393] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a276048f05636c3a00ed4a2","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a276048f05636c3a00ed4a2: done: 0.046608 sec","job_status":"done","queue_duration_s":167.910152,"scheduling_latency_s":167.910196,"redis_calls":13,"redis_duration_s":0.014343,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002611,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046608,"completed_at":"2026-09-09T10:38:59.077Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2061gitlab # [ 448.547827] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa236092800b23f8d80173e0","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa236092800b23f8d80173e0: start","job_status":"start","queue_duration_s":167.964176,"scheduling_latency_s":167.964234}2062gitlab # [ 448.603988] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa236092800b23f8d80173e0","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa236092800b23f8d80173e0: done: 0.063469 sec","job_status":"done","queue_duration_s":167.964176,"scheduling_latency_s":167.964234,"redis_calls":13,"redis_duration_s":0.018840000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004179,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.014661,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.063469,"completed_at":"2026-09-09T10:38:59.148Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2063gitlab # [ 448.606145] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"563042eae254f8a905689881","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-563042eae254f8a905689881: start","job_status":"start","queue_duration_s":168.034518,"scheduling_latency_s":168.034574}2064gitlab # [ 448.620873] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"563042eae254f8a905689881","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-563042eae254f8a905689881: done: 0.051732 sec","job_status":"done","queue_duration_s":168.034518,"scheduling_latency_s":168.034574,"redis_calls":13,"redis_duration_s":0.01515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012578,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.051732,"completed_at":"2026-09-09T10:38:59.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2065gitlab # [ 448.718230] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c155825a44ae5c5e892520fa","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c155825a44ae5c5e892520fa: start","job_status":"start","queue_duration_s":168.090735,"scheduling_latency_s":168.090784}2066gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2067gitlab # [ 448.719745] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c155825a44ae5c5e892520fa","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c155825a44ae5c5e892520fa: done: 0.026357 sec","job_status":"done","queue_duration_s":168.090735,"scheduling_latency_s":168.090784,"redis_calls":13,"redis_duration_s":0.005423000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003429,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026357,"completed_at":"2026-09-09T10:38:59.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2068gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.05 seconds)2069gitlab # [ 448.893485] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"666df72c5df0f94050527c99","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-666df72c5df0f94050527c99: start","job_status":"start","queue_duration_s":168.119175,"scheduling_latency_s":168.119213}2070gitlab # [ 448.894859] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"666df72c5df0f94050527c99","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-666df72c5df0f94050527c99: done: 0.022198 sec","job_status":"done","queue_duration_s":168.119175,"scheduling_latency_s":168.119213,"redis_calls":13,"redis_duration_s":0.00366,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001144,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002516,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022198,"completed_at":"2026-09-09T10:38:59.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2071gitlab # [ 448.923382] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdd26ba292b6458a7ba53a13","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdd26ba292b6458a7ba53a13: start","job_status":"start","queue_duration_s":168.143942,"scheduling_latency_s":168.143982}2072gitlab # [ 448.940309] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdd26ba292b6458a7ba53a13","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdd26ba292b6458a7ba53a13: done: 0.031258 sec","job_status":"done","queue_duration_s":168.143942,"scheduling_latency_s":168.143982,"redis_calls":13,"redis_duration_s":0.005828,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002032,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003796,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031258,"completed_at":"2026-09-09T10:38:59.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2073gitlab # [ 449.008710] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92239bdd893e8d66d97f1c2f","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92239bdd893e8d66d97f1c2f: start","job_status":"start","queue_duration_s":168.177728,"scheduling_latency_s":168.177767}2074gitlab # [ 449.010802] nixbot[3042]: INFO: ::ffff:127.0.0.1:58464 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2075gitlab # [ 449.011994] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92239bdd893e8d66d97f1c2f","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92239bdd893e8d66d97f1c2f: done: 0.03912 sec","job_status":"done","queue_duration_s":168.177728,"scheduling_latency_s":168.177767,"redis_calls":13,"redis_duration_s":0.010298,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002762,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007536,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03912,"completed_at":"2026-09-09T10:38:59.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2076gitlab # [ 449.109965] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a83b32e8a2adea1dfa5e5c5","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a83b32e8a2adea1dfa5e5c5: start","job_status":"start","queue_duration_s":168.219963,"scheduling_latency_s":168.220008}2077gitlab # [ 449.111074] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a83b32e8a2adea1dfa5e5c5","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a83b32e8a2adea1dfa5e5c5: done: 0.047119 sec","job_status":"done","queue_duration_s":168.219963,"scheduling_latency_s":168.220008,"redis_calls":13,"redis_duration_s":0.016356,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011368,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.047119,"completed_at":"2026-09-09T10:38:59.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2078gitlab # [ 449.156699] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b336d6ebc3809619c082b71","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b336d6ebc3809619c082b71: start","job_status":"start","queue_duration_s":168.271984,"scheduling_latency_s":168.272032}2079gitlab # [ 449.187781] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b336d6ebc3809619c082b71","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b336d6ebc3809619c082b71: done: 0.039129 sec","job_status":"done","queue_duration_s":168.271984,"scheduling_latency_s":168.272032,"redis_calls":13,"redis_duration_s":0.007934,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039129,"completed_at":"2026-09-09T10:38:59.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2080gitlab # [ 449.282878] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"833bd91e9274ec9b55f28cc8","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-833bd91e9274ec9b55f28cc8: start","job_status":"start","queue_duration_s":168.313836,"scheduling_latency_s":168.313898}2081gitlab # [ 449.283949] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"833bd91e9274ec9b55f28cc8","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-833bd91e9274ec9b55f28cc8: done: 0.029255 sec","job_status":"done","queue_duration_s":168.313836,"scheduling_latency_s":168.313898,"redis_calls":13,"redis_duration_s":0.004378,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029255,"completed_at":"2026-09-09T10:38:59.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2082gitlab # [ 449.407454] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3467a5115e06ac2ffb271c1","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3467a5115e06ac2ffb271c1: start","job_status":"start","queue_duration_s":168.347155,"scheduling_latency_s":168.347216}2083gitlab # [ 449.413792] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3467a5115e06ac2ffb271c1","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3467a5115e06ac2ffb271c1: done: 0.032508 sec","job_status":"done","queue_duration_s":168.347155,"scheduling_latency_s":168.347216,"redis_calls":13,"redis_duration_s":0.004694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002803,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032508,"completed_at":"2026-09-09T10:38:59.500Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2084gitlab # [ 449.520321] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"279a0140936f262e1c429f80","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-279a0140936f262e1c429f80: start","job_status":"start","queue_duration_s":168.387238,"scheduling_latency_s":168.387346}2085gitlab # [ 449.523556] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"279a0140936f262e1c429f80","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-279a0140936f262e1c429f80: done: 0.035103 sec","job_status":"done","queue_duration_s":168.387238,"scheduling_latency_s":168.387346,"redis_calls":13,"redis_duration_s":0.008571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005457,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035103,"completed_at":"2026-09-09T10:38:59.542Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2086gitlab # [ 449.618894] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"519c37595f24bfb098cdd533","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-519c37595f24bfb098cdd533: start","job_status":"start","queue_duration_s":168.424996,"scheduling_latency_s":168.425039}2087gitlab # [ 449.620045] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"519c37595f24bfb098cdd533","created_at":"2026-09-09T10:36:10.595Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-8dfb202e25e74084","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"17eae5de8495bcb5b174f8209c2d8b41","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:11.120Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-519c37595f24bfb098cdd533: done: 0.026952 sec","job_status":"done","queue_duration_s":168.424996,"scheduling_latency_s":168.425039,"redis_calls":13,"redis_duration_s":0.003706,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001264,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002442,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026952,"completed_at":"2026-09-09T10:38:59.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2088gitlab # [ 449.705470] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"6708c9fdf674e424b604cf03","created_at":"2026-09-09T10:36:12.265Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-c873b62e94cd4b40","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"091cf34e8d64c433979347ad91ce7795","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:12.288Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-6708c9fdf674e424b604cf03: start","job_status":"start","queue_duration_s":167.287,"scheduling_latency_s":167.28704}2089gitlab # [ 449.705892] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"6708c9fdf674e424b604cf03","created_at":"2026-09-09T10:36:12.265Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-c873b62e94cd4b40","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"091cf34e8d64c433979347ad91ce7795","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:12.288Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-6708c9fdf674e424b604cf03: done: 0.125887 sec","job_status":"done","queue_duration_s":167.287,"scheduling_latency_s":167.28704,"redis_calls":19,"redis_duration_s":0.008834,"redis_read_bytes":18,"redis_write_bytes":2650,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003285,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1330,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00302,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.033,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.033,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000896203,"duration_s":0.125887,"completed_at":"2026-09-09T10:38:59.701Z","load_balancing_strategy":"primary","db_duration_s":0.033801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2090gitlab # [ 449.767464] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.704Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ef8461379657deb0c82b8f48","created_at":"2026-09-09T10:36:12.736Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-6e7e07df653440ee","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"308a4b7521e839ddcd4cf3a7e731a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:12.761Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ef8461379657deb0c82b8f48: start","job_status":"start","queue_duration_s":166.943825,"scheduling_latency_s":166.943876}2091gitlab # [ 449.774686] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.755Z","message":"No existing merge request to be cleaned up."}2092gitlab # [ 449.781974] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.795Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ef8461379657deb0c82b8f48","created_at":"2026-09-09T10:36:12.736Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-6e7e07df653440ee","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"308a4b7521e839ddcd4cf3a7e731a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:12.761Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ef8461379657deb0c82b8f48: done: 0.090685 sec","job_status":"done","queue_duration_s":166.943825,"scheduling_latency_s":166.943876,"redis_calls":14,"redis_duration_s":0.014902,"redis_read_bytes":12,"redis_write_bytes":1678,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002667,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.007693,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":5,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090685,"completed_at":"2026-09-09T10:38:59.795Z","load_balancing_strategy":"primary","db_duration_s":0.011302,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2093gitlab # [ 449.862963] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.799Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a01e094741ee4ff9c53eb57a","created_at":"2026-09-09T10:36:12.736Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-6e7e07df653440ee","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"308a4b7521e839ddcd4cf3a7e731a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:12.761Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a01e094741ee4ff9c53eb57a: start","job_status":"start","queue_duration_s":167.037937,"scheduling_latency_s":167.037987}2094gitlab # [ 449.864162] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.833Z","message":"No existing merge request to be cleaned up."}2095gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2096gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.06 seconds)2097gitlab # [ 449.865397] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.868Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a01e094741ee4ff9c53eb57a","created_at":"2026-09-09T10:36:12.736Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-6e7e07df653440ee","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"308a4b7521e839ddcd4cf3a7e731a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:12.761Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a01e094741ee4ff9c53eb57a: done: 0.069808 sec","job_status":"done","queue_duration_s":167.037937,"scheduling_latency_s":167.037987,"redis_calls":10,"redis_duration_s":0.008805,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005231,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.069808,"completed_at":"2026-09-09T10:38:59.868Z","load_balancing_strategy":"primary","db_duration_s":0.009314,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2098gitlab # [ 449.972258] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.875Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9649ede747e813f8ab19fbf4","created_at":"2026-09-09T10:36:12.736Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-6e7e07df653440ee","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"308a4b7521e839ddcd4cf3a7e731a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:12.761Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9649ede747e813f8ab19fbf4: start","job_status":"start","queue_duration_s":167.113994,"scheduling_latency_s":167.114162}2099gitlab # [ 449.973682] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.917Z","message":"No existing merge request to be cleaned up."}2100gitlab # [ 449.976318] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.948Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9649ede747e813f8ab19fbf4","created_at":"2026-09-09T10:36:12.736Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-6e7e07df653440ee","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"308a4b7521e839ddcd4cf3a7e731a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:12.761Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9649ede747e813f8ab19fbf4: done: 0.073332 sec","job_status":"done","queue_duration_s":167.113994,"scheduling_latency_s":167.114162,"redis_calls":10,"redis_duration_s":0.011472999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.007935,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.073332,"completed_at":"2026-09-09T10:38:59.948Z","load_balancing_strategy":"primary","db_duration_s":0.005107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2101gitlab # [ 450.062657] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:38:59.973Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"36de98678a823703e885e40c","created_at":"2026-09-09T10:36:12.736Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-6e7e07df653440ee","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"308a4b7521e839ddcd4cf3a7e731a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:12.761Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-36de98678a823703e885e40c: start","job_status":"start","queue_duration_s":167.212501,"scheduling_latency_s":167.212563}2102gitlab # [ 450.064203] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:00.021Z","message":"No existing merge request to be cleaned up."}2103gitlab # [ 450.074231] nixbot[3042]: INFO: ::ffff:127.0.0.1:58480 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2104gitlab # [ 450.076266] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:00.059Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"36de98678a823703e885e40c","created_at":"2026-09-09T10:36:12.736Z","trace_propagation_headers":{"sentry-trace":"c55fb6adb01d492cac7506d9e7f90041-6e7e07df653440ee","baggage":"sentry-trace_id=c55fb6adb01d492cac7506d9e7f90041,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"308a4b7521e839ddcd4cf3a7e731a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:12.761Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-36de98678a823703e885e40c: done: 0.086235 sec","job_status":"done","queue_duration_s":167.212501,"scheduling_latency_s":167.212563,"redis_calls":10,"redis_duration_s":0.034816,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.014705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.020111,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.086235,"completed_at":"2026-09-09T10:39:00.059Z","load_balancing_strategy":"primary","db_duration_s":0.004724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2105gitlab # [ 450.176510] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:00.063Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"585c587d1fa3d2c07f1497b5","created_at":"2026-09-09T10:36:17.135Z","trace_propagation_headers":{"sentry-trace":"b415af09dcc6420a887628a6d3bbd120-92395ea6ab91401a","baggage":"sentry-trace_id=b415af09dcc6420a887628a6d3bbd120,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VTQT4RF3N7V46A27ACQJS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:17.177Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-585c587d1fa3d2c07f1497b5: start","job_status":"start","queue_duration_s":162.886156,"scheduling_latency_s":162.886211}2106gitlab # [ 450.182561] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:00.324Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"585c587d1fa3d2c07f1497b5","created_at":"2026-09-09T10:36:17.135Z","trace_propagation_headers":{"sentry-trace":"b415af09dcc6420a887628a6d3bbd120-92395ea6ab91401a","baggage":"sentry-trace_id=b415af09dcc6420a887628a6d3bbd120,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VTQT4RF3N7V46A27ACQJS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:17.177Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-585c587d1fa3d2c07f1497b5: done: 0.261263 sec","job_status":"done","queue_duration_s":162.886156,"scheduling_latency_s":162.886211,"redis_calls":13,"redis_duration_s":0.007937,"redis_read_bytes":138,"redis_write_bytes":1593,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001518,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":428,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003204,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003215,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.156862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.192191745,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.261263,"completed_at":"2026-09-09T10:39:00.324Z","load_balancing_strategy":"primary","db_duration_s":0.099685,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2107gitlab # [ 450.295224] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:00.328Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"5c10405c6dc7e80ff71c3e91","created_at":"2026-09-09T10:36:17.191Z","trace_propagation_headers":{"sentry-trace":"b415af09dcc6420a887628a6d3bbd120-92395ea6ab91401a","baggage":"sentry-trace_id=b415af09dcc6420a887628a6d3bbd120,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VTQT4RF3N7V46A27ACQJS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:17.202Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-5c10405c6dc7e80ff71c3e91: start","job_status":"start","queue_duration_s":163.126099,"scheduling_latency_s":163.126146}2108gitlab # [ 450.297474] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:00.575Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"5c10405c6dc7e80ff71c3e91","created_at":"2026-09-09T10:36:17.191Z","trace_propagation_headers":{"sentry-trace":"b415af09dcc6420a887628a6d3bbd120-92395ea6ab91401a","baggage":"sentry-trace_id=b415af09dcc6420a887628a6d3bbd120,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VTQT4RF3N7V46A27ACQJS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:17.202Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-5c10405c6dc7e80ff71c3e91: done: 0.247533 sec","job_status":"done","queue_duration_s":163.126099,"scheduling_latency_s":163.126146,"redis_calls":14,"redis_duration_s":0.009817,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001902,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004018,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003897,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.15139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.18065480399999997,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.247533,"completed_at":"2026-09-09T10:39:00.575Z","load_balancing_strategy":"primary","db_duration_s":0.062861,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2109gitlab # [ 450.380223] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:00.585Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"0fb716c9d1c7e170b6bcfb8a","created_at":"2026-09-09T10:36:18.244Z","trace_propagation_headers":{"sentry-trace":"b415af09dcc6420a887628a6d3bbd120-92395ea6ab91401a","baggage":"sentry-trace_id=b415af09dcc6420a887628a6d3bbd120,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VTQT4RF3N7V46A27ACQJS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:18.259Z","job_size_bytes":5,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-0fb716c9d1c7e170b6bcfb8a: start","job_status":"start","queue_duration_s":162.326363,"scheduling_latency_s":162.326426}2110gitlab # [ 450.382075] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:01.044Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"0fb716c9d1c7e170b6bcfb8a","created_at":"2026-09-09T10:36:18.244Z","trace_propagation_headers":{"sentry-trace":"b415af09dcc6420a887628a6d3bbd120-92395ea6ab91401a","baggage":"sentry-trace_id=b415af09dcc6420a887628a6d3bbd120,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VTQT4RF3N7V46A27ACQJS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:18.259Z","job_size_bytes":5,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-0fb716c9d1c7e170b6bcfb8a: done: 0.459232 sec","job_status":"done","queue_duration_s":162.326363,"scheduling_latency_s":162.326426,"redis_calls":12,"redis_duration_s":0.011592,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.003434,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.006894,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001264,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.270907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00365242,"duration_s":0.459232,"completed_at":"2026-09-09T10:39:01.044Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.072445,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2111gitlab # [ 450.463342] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:01.051Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"1decc5d7fba96c6c01b4decf","created_at":"2026-09-09T10:36:18.310Z","trace_propagation_headers":{"sentry-trace":"b415af09dcc6420a887628a6d3bbd120-92395ea6ab91401a","baggage":"sentry-trace_id=b415af09dcc6420a887628a6d3bbd120,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VTQT4RF3N7V46A27ACQJS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:18.324Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-1decc5d7fba96c6c01b4decf: start","job_status":"start","queue_duration_s":162.727442,"scheduling_latency_s":162.727506}2112gitlab # [ 450.556166] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:01.643Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"1decc5d7fba96c6c01b4decf","created_at":"2026-09-09T10:36:18.310Z","trace_propagation_headers":{"sentry-trace":"b415af09dcc6420a887628a6d3bbd120-92395ea6ab91401a","baggage":"sentry-trace_id=b415af09dcc6420a887628a6d3bbd120,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VTQT4RF3N7V46A27ACQJS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:18.324Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-1decc5d7fba96c6c01b4decf: done: 0.59138 sec","job_status":"done","queue_duration_s":162.727442,"scheduling_latency_s":162.727506,"redis_calls":11,"redis_duration_s":0.009598,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.003032,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005235,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001331,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":36,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.085,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.489,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.489,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.083,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.364543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000675225,"duration_s":0.59138,"completed_at":"2026-09-09T10:39:01.642Z","load_balancing_strategy":"primary","db_duration_s":0.196395,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2113gitlab # [ 450.561250] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:01.650Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"40d2876eab7d6cb48163f292","created_at":"2026-09-09T10:36:18.332Z","trace_propagation_headers":{"sentry-trace":"b415af09dcc6420a887628a6d3bbd120-92395ea6ab91401a","baggage":"sentry-trace_id=b415af09dcc6420a887628a6d3bbd120,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VTQT4RF3N7V46A27ACQJS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:18.347Z","job_size_bytes":89,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-40d2876eab7d6cb48163f292: start","job_status":"start","queue_duration_s":163.302566,"scheduling_latency_s":163.30262}2114gitlab # [ 450.653853] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:01.743Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"40d2876eab7d6cb48163f292","created_at":"2026-09-09T10:36:18.332Z","trace_propagation_headers":{"sentry-trace":"b415af09dcc6420a887628a6d3bbd120-92395ea6ab91401a","baggage":"sentry-trace_id=b415af09dcc6420a887628a6d3bbd120,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VTQT4RF3N7V46A27ACQJS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:18.347Z","job_size_bytes":89,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-40d2876eab7d6cb48163f292: done: 0.094044 sec","job_status":"done","queue_duration_s":163.302566,"scheduling_latency_s":163.30262,"redis_calls":11,"redis_duration_s":0.009622,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.002605,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002442,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001150426,"duration_s":0.094044,"completed_at":"2026-09-09T10:39:01.743Z","load_balancing_strategy":"primary","db_duration_s":0.013777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2115gitlab # [ 450.737970] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:01.754Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 23c0426c7d7244e6daf15e71d94c768e8374df0e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"e1636a3f437f03eba8ad68f8","created_at":"2026-09-09T10:36:27.827Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-6072eda1edf84904","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:27.837Z","job_size_bytes":185,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-e1636a3f437f03eba8ad68f8: start","job_status":"start","queue_duration_s":153.917392,"scheduling_latency_s":153.917456}2116gitlab # [ 450.739447] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:01.840Z","message":"changes: \"0000000000000000000000000000000000000000 23c0426c7d7244e6daf15e71d94c768e8374df0e refs/heads/master\\n\""}2117gitlab # [ 450.741268] gitaly[863]: time="2026-09-09T10:39:01.943Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:11.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:01.928" grpc.time_ms=14.323 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118gitlab # [ 450.742382] gitaly[863]: time="2026-09-09T10:39:01.973Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=6 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:39:11.034" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:39:01.955" grpc.time_ms=17.702 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2119gitlab # [ 450.887541] gitaly[863]: time="2026-09-09T10:39:02.141Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-09T10:39:12.002" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:02.122" grpc.time_ms=18.379 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2121gitlab # [ 450.967263] gitaly[863]: time="2026-09-09T10:39:02.221Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:39:02.220" grpc.time_ms=0.707 pid=863 span.kind=server system=grpc2122gitlab # [ 451.034536] gitaly[863]: time="2026-09-09T10:39:02.288Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:39:02.287" grpc.time_ms=0.805 pid=863 span.kind=server system=grpc2123gitlab # [ 451.047533] nixbot[3042]: INFO: ::ffff:127.0.0.1:58492 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2124gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.08 seconds)2125gitlab # [ 451.076179] gitaly[863]: time="2026-09-09T10:39:02.326Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 diskcache=156bdd9a-0d93-40a3-925e-55281c9ae3b6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:39:12.052" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:39:02.173" pid=863 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2126gitlab # [ 451.076965] gitaly[863]: time="2026-09-09T10:39:02.327Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=96 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4630 command.oublock=8 command.real_time_ms=136 command.spawn_token_fork_ms=4 command.system_time_ms=66 command.user_time_ms=30 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:39:12.052" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:39:02.173" grpc.time_ms=153.786 pid=863 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2127gitlab # [ 451.108587] gitaly[863]: time="2026-09-09T10:39:02.362Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:39:12.241" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:39:02.361" grpc.time_ms=0.301 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 451.146941] gitaly[863]: time="2026-09-09T10:39:02.400Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=941 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-09T10:39:12.256" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:02.376" grpc.time_ms=23.346 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 451.359907] gitaly[863]: time="2026-09-09T10:39:02.613Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=338 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-09T10:39:32.005" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:02.606" grpc.time_ms=7.377 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 451.443466] gitaly[863]: time="2026-09-09T10:39:02.697Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-09T10:39:12.005" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:39:02.696" grpc.time_ms=0.391 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab # [ 451.462645] gitaly[863]: time="2026-09-09T10:39:02.716Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-09T10:39:12.018" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-09T10:39:02.708" grpc.time_ms=7.471 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2132gitlab # [ 451.510842] gitaly[863]: time="2026-09-09T10:39:02.764Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:12.059" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:02.750" grpc.time_ms=14.155 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 451.537937] gitaly[863]: time="2026-09-09T10:39:02.791Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:12.089" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:02.779" grpc.time_ms=11.505 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 451.591911] gitaly[863]: time="2026-09-09T10:39:02.845Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-09T10:39:32.221" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:02.822" grpc.time_ms=23.237 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2135gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2136gitlab # [ 452.111238] nixbot[3042]: INFO: ::ffff:127.0.0.1:58496 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2137gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.07 seconds)2138gitlab # [ 452.816524] gitaly[863]: time="2026-09-09T10:39:04.065Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-09T10:39:14.001" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:04.061" grpc.time_ms=3.57 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab # [ 452.938516] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:04.190Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 23c0426c7d7244e6daf15e71d94c768e8374df0e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"e1636a3f437f03eba8ad68f8","created_at":"2026-09-09T10:36:27.827Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-6072eda1edf84904","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:27.837Z","job_size_bytes":185,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-e1636a3f437f03eba8ad68f8: done: 2.435458 sec","job_status":"done","queue_duration_s":153.917392,"scheduling_latency_s":153.917456,"gitaly_calls":13,"gitaly_duration_s":0.434219,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.173069,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.011391,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.020565,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.005435,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.034024,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.058553,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.043101,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.157,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.465,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.528,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.157,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.483672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002048026,"exclusive_lock_hold_duration_s":0.092109473,"duration_s":2.435458,"completed_at":"2026-09-09T10:39:04.190Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.251714,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2140gitlab # [ 453.049876] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:04.302Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"6c7ab1015730cf04d2cee433","created_at":"2026-09-09T10:36:36.174Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-f0491b71788d4a8f","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:36.207Z","job_size_bytes":65,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-6c7ab1015730cf04d2cee433: start","job_status":"start","queue_duration_s":148.095397,"scheduling_latency_s":148.095465}2141gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2142gitlab # [ 453.161702] nixbot[3042]: INFO: ::ffff:127.0.0.1:51120 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2143gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.05 seconds)2144gitlab # [ 453.281377] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:04.534Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"6c7ab1015730cf04d2cee433","created_at":"2026-09-09T10:36:36.174Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-f0491b71788d4a8f","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:36.207Z","job_size_bytes":65,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-6c7ab1015730cf04d2cee433: done: 0.231583 sec","job_status":"done","queue_duration_s":148.095397,"scheduling_latency_s":148.095465,"redis_calls":16,"redis_duration_s":0.013706,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.005203,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005043,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.134158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001030019,"duration_s":0.231583,"completed_at":"2026-09-09T10:39:04.534Z","load_balancing_strategy":"primary","db_duration_s":0.04886,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2145gitlab # [ 453.286225] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:04.539Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4a9e1c20a0760a45b7c8abd2","created_at":"2026-09-09T10:36:36.217Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-f0491b71788d4a8f","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:36.232Z","job_size_bytes":65,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4a9e1c20a0760a45b7c8abd2: start","job_status":"start","queue_duration_s":148.30701,"scheduling_latency_s":148.307069}2146gitlab # [ 453.536120] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:04.789Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4a9e1c20a0760a45b7c8abd2","created_at":"2026-09-09T10:36:36.217Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-f0491b71788d4a8f","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:36.232Z","job_size_bytes":65,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4a9e1c20a0760a45b7c8abd2: done: 0.249748 sec","job_status":"done","queue_duration_s":148.30701,"scheduling_latency_s":148.307069,"redis_calls":21,"redis_duration_s":0.024699,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.009679,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005465,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.009555,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.15594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000764064,"duration_s":0.249748,"completed_at":"2026-09-09T10:39:04.788Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054009,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2147gitlab # [ 453.539799] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:04.793Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"27f28f5a721da8c650b3882a","created_at":"2026-09-09T10:36:36.454Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-f0491b71788d4a8f","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:36.466Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-27f28f5a721da8c650b3882a: start","job_status":"start","queue_duration_s":148.326811,"scheduling_latency_s":148.326863}2148gitlab # [ 453.968064] gitaly[863]: time="2026-09-09T10:39:05.221Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:39:05.220" grpc.time_ms=0.652 pid=863 span.kind=server system=grpc2149gitlab # [ 454.054193] gitaly[863]: time="2026-09-09T10:39:05.307Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:39:05.307" grpc.time_ms=0.63 pid=863 span.kind=server system=grpc2150gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2151gitlab # [ 454.167151] gitaly[863]: time="2026-09-09T10:39:05.419Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:39:05.416" grpc.time_ms=2.897 pid=863 span.kind=server system=grpc2152gitlab # [ 454.236341] nixbot[3042]: INFO: ::ffff:127.0.0.1:51134 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2153gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.08 seconds)2154gitlab # [ 454.250992] gitaly[863]: time="2026-09-09T10:39:05.504Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM diskcache=b38c641a-ecdd-4bd8-bbe3-9a56c7146477 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:39:35.061" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:05.161" pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 454.270601] gitaly[863]: time="2026-09-09T10:39:05.505Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=185 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=823296 command.minflt=7151 command.oublock=0 command.real_time_ms=277 command.spawn_token_fork_ms=4 command.system_time_ms=130 command.user_time_ms=55 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:39:35.061" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:05.161" grpc.time_ms=343.038 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 454.518231] gitaly[863]: time="2026-09-09T10:39:05.771Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:39:35.669" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:05.770" grpc.time_ms=1.331 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 454.595799] gitaly[863]: time="2026-09-09T10:39:05.849Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVB4EJ3XEZECS3VAEVSFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:35.747" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:05.848" grpc.time_ms=1.275 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2158gitlab # [ 454.630557] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:05.882Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"27f28f5a721da8c650b3882a","created_at":"2026-09-09T10:36:36.454Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-f0491b71788d4a8f","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:36.466Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-27f28f5a721da8c650b3882a: done: 1.089836 sec","job_status":"done","queue_duration_s":148.326811,"scheduling_latency_s":148.326863,"gitaly_calls":3,"gitaly_duration_s":0.363477,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.092715,"redis_read_bytes":455,"redis_write_bytes":28000,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.005949,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.003467,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.042879,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006952,"redis_queues_read_bytes":34,"redis_queues_write_bytes":14494,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.017192,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.002493,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001554,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00628,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.111,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.043,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.058,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.059,"db_ci_duration_s":0.052,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.514417,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.92899321,"duration_s":1.089836,"completed_at":"2026-09-09T10:39:05.882Z","load_balancing_strategy":"primary","db_duration_s":0.136947,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2159gitlab # [ 454.713771] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:05.966Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","23c0426c7d7244e6daf15e71d94c768e8374df0e 31a0e91e37b3d59648d358ba62ce24822d73dead refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c5f4976dd6817c4327d53adc","created_at":"2026-09-09T10:38:55.871Z","trace_propagation_headers":{"sentry-trace":"11d6afd5899641918c5b6b73293077ed-18491d07467c47d1","baggage":"sentry-trace_id=11d6afd5899641918c5b6b73293077ed,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VZKAQ14VTF170BVKAY02W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:55.880Z","job_size_bytes":185,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c5f4976dd6817c4327d53adc: start","job_status":"start","queue_duration_s":10.086376,"scheduling_latency_s":10.086433}2160gitlab # [ 454.735566] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:05.989Z","message":"changes: \"23c0426c7d7244e6daf15e71d94c768e8374df0e 31a0e91e37b3d59648d358ba62ce24822d73dead refs/heads/master\\n\""}2161gitlab # [ 454.780437] gitaly[863]: time="2026-09-09T10:39:06.034Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=8 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:16.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:06.022" grpc.time_ms=11.488 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 454.815795] gitaly[863]: time="2026-09-09T10:39:06.069Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:39:16.036" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:39:06.057" grpc.time_ms=11.775 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163gitlab # [ 454.833336] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:06.086Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d2dea9403fec9728d7353572","created_at":"2026-09-09T10:39:06.079Z","trace_propagation_headers":{"sentry-trace":"11d6afd5899641918c5b6b73293077ed-2110b74396ca42c5","baggage":"sentry-trace_id=11d6afd5899641918c5b6b73293077ed,sentry-release=Unknown"},"correlation_id":"01M22VZKAQ14VTF170BVKAY02W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"2dd353fcdaf216a66eb5275b","job_size_bytes":46,"pid":2922,"job_status":"deduplicated","message":"ProjectCacheWorker JID-d2dea9403fec9728d7353572: deduplicated: until executing","deduplication.type":"until executing"}2164gitlab # [ 454.896599] gitaly[863]: time="2026-09-09T10:39:06.149Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-09T10:39:16.112" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:06.133" grpc.time_ms=16.426 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 454.943946] gitaly[863]: time="2026-09-09T10:39:06.194Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-09T10:39:36.076" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:06.177" grpc.time_ms=16.517 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 454.989943] gitaly[863]: time="2026-09-09T10:39:06.235Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=348 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-09T10:39:16.200" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-09T10:39:06.220" grpc.time_ms=14.191 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 455.037678] gitaly[863]: time="2026-09-09T10:39:06.291Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:16.257" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:06.278" grpc.time_ms=12.423 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab # [ 455.196376] gitaly[863]: time="2026-09-09T10:39:06.450Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-09T10:39:16.007" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:06.448" grpc.time_ms=1.645 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2170gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.05 seconds)2171gitlab # [ 455.235839] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:06.487Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","23c0426c7d7244e6daf15e71d94c768e8374df0e 31a0e91e37b3d59648d358ba62ce24822d73dead refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c5f4976dd6817c4327d53adc","created_at":"2026-09-09T10:38:55.871Z","trace_propagation_headers":{"sentry-trace":"11d6afd5899641918c5b6b73293077ed-18491d07467c47d1","baggage":"sentry-trace_id=11d6afd5899641918c5b6b73293077ed,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VZKAQ14VTF170BVKAY02W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:55.880Z","job_size_bytes":185,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c5f4976dd6817c4327d53adc: done: 0.5208 sec","job_status":"done","queue_duration_s":10.086376,"scheduling_latency_s":10.086433,"gitaly_calls":7,"gitaly_duration_s":0.14853,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.065795,"redis_read_bytes":501,"redis_write_bytes":11941,"redis_cache_calls":9,"redis_cache_duration_s":0.00801,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001469,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5718,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.011459,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.024981,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.019876,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.046,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.046,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.2496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001836826,"exclusive_lock_hold_duration_s":0.028505578,"duration_s":0.5208,"completed_at":"2026-09-09T10:39:06.487Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043102,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2172gitlab # [ 455.298894] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:06.493Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2dd353fcdaf216a66eb5275b","created_at":"2026-09-09T10:39:01.978Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-f270a15807984d1c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:02.020Z","job_size_bytes":46,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2dd353fcdaf216a66eb5275b: start","job_status":"start","queue_duration_s":4.47331,"scheduling_latency_s":4.473353}2173gitlab # [ 455.300334] nixbot[3042]: INFO: ::ffff:127.0.0.1:51148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2174gitlab # [ 455.337783] gitaly[863]: time="2026-09-09T10:39:06.591Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-09T16:39:06.586" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:39:06.587" grpc.time_ms=3.817 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 455.366663] gitaly[863]: time="2026-09-09T10:39:06.620Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-09T10:39:36.508" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:06.609" grpc.time_ms=11.139 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 455.432630] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:06.683Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2dd353fcdaf216a66eb5275b","created_at":"2026-09-09T10:39:01.978Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-f270a15807984d1c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:02.020Z","job_size_bytes":46,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2dd353fcdaf216a66eb5275b: done: 0.189807 sec","job_status":"done","queue_duration_s":4.47331,"scheduling_latency_s":4.473353,"gitaly_calls":2,"gitaly_duration_s":0.025524,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.016003,"redis_read_bytes":69,"redis_write_bytes":4882,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.00228,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000989,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004131,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.006995,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001608,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.119487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001920077,"duration_s":0.189807,"completed_at":"2026-09-09T10:39:06.683Z","load_balancing_strategy":"primary","db_duration_s":0.02985,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2177gitlab # [ 455.449042] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:06.691Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"6d6e90ff6a8f5264c0ebf226","created_at":"2026-09-09T10:39:02.081Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-f270a15807984d1c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:02.107Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-6d6e90ff6a8f5264c0ebf226: start","job_status":"start","queue_duration_s":4.583976,"scheduling_latency_s":4.58403}2178gitlab # [ 455.610155] gitaly[863]: time="2026-09-09T10:39:06.862Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 diskcache=a4e6ba1c-94fd-427b-81de-4e1be88c2e6b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-09T16:39:06.773" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:06.773" pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 455.611750] gitaly[863]: time="2026-09-09T10:39:06.863Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1283 command.oublock=0 command.real_time_ms=80 command.spawn_token_fork_ms=40 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-09T16:39:06.773" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:06.773" grpc.time_ms=89.423 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 455.733973] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:06.984Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"6d6e90ff6a8f5264c0ebf226","created_at":"2026-09-09T10:39:02.081Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-f270a15807984d1c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:02.107Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-6d6e90ff6a8f5264c0ebf226: done: 0.292975 sec","job_status":"done","queue_duration_s":4.583976,"scheduling_latency_s":4.58403,"gitaly_calls":1,"gitaly_duration_s":0.098924,"redis_calls":15,"redis_duration_s":0.020139,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002736,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003835,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.005602,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007966,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.037,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.069,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.218922796,"duration_s":0.292975,"completed_at":"2026-09-09T10:39:06.984Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2181gitlab # [ 455.828984] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:06.992Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ef1402423d1f709088a4af39","created_at":"2026-09-09T10:39:02.351Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-f270a15807984d1c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:02.355Z","job_size_bytes":23,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ef1402423d1f709088a4af39: start","job_status":"start","queue_duration_s":4.636087,"scheduling_latency_s":4.636269}2182gitlab # [ 455.932338] gitaly[863]: time="2026-09-09T10:39:07.185Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=40 command.spawn_token_fork_ms=12 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-09T10:39:37.042" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:07.143" grpc.time_ms=41.951 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab # [ 455.982285] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:07.232Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ef1402423d1f709088a4af39","created_at":"2026-09-09T10:39:02.351Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-f270a15807984d1c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:02.355Z","job_size_bytes":23,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ef1402423d1f709088a4af39: done: 0.24096 sec","job_status":"done","queue_duration_s":4.636087,"scheduling_latency_s":4.636269,"gitaly_calls":1,"gitaly_duration_s":0.047229,"redis_calls":16,"redis_duration_s":0.090752,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.003358,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007916,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.0756,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003878,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.24096,"completed_at":"2026-09-09T10:39:07.232Z","load_balancing_strategy":"primary","db_duration_s":0.012832,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2184gitlab # [ 455.990819] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:07.241Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b39386f0d5d451f68c8238bf","created_at":"2026-09-09T10:39:03.425Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-f270a15807984d1c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e52e60665ac9f84e1115b8a1b8aefa3a28dc53576e4bbd2084ca91187ae9cd2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:03.437Z","job_size_bytes":467,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b39386f0d5d451f68c8238bf: start","job_status":"start","queue_duration_s":3.803975,"scheduling_latency_s":3.804032}2185gitlab # [ 456.092504] gitaly[863]: time="2026-09-09T10:39:07.345Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:37.243" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:07.343" grpc.time_ms=1.802 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2186gitlab # [ 456.199038] gitaly[863]: time="2026-09-09T10:39:07.451Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-09T10:39:17.003" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:07.433" grpc.time_ms=17.402 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2187gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2188gitlab # [ 456.342932] nixbot[3042]: INFO: ::ffff:127.0.0.1:51158 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2189gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.05 seconds)2190gitlab # [ 456.464081] gitaly[863]: time="2026-09-09T10:39:07.717Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:39:37.615" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:07.716" grpc.time_ms=1.373 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2191gitlab # [ 456.480113] gitaly[863]: time="2026-09-09T10:39:07.733Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=42 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-09T10:39:37.624" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:07.725" grpc.time_ms=8.17 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2192gitlab # [ 456.714795] gitaly[863]: time="2026-09-09T10:39:07.967Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=9 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:17.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:07.944" grpc.time_ms=23.28 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2194gitlab # [ 457.394971] nixbot[3042]: INFO: ::ffff:127.0.0.1:51160 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2195gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.05 seconds)2196gitlab # [ 458.016058] gitaly[863]: time="2026-09-09T10:39:09.267Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=968 command.oublock=0 command.real_time_ms=40 command.spawn_token_fork_ms=15 command.system_time_ms=11 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-09T10:39:39.019" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:09.220" grpc.time_ms=47.067 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 458.052576] gitaly[863]: time="2026-09-09T10:39:09.305Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VV2S8Z5SQJE5CX0NVH745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-09T10:39:39.075" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:09.276" grpc.time_ms=28.809 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab # [ 458.149342] sidekiq-cluster[2922]: {"severity":"WARN","time":"2026-09-09T10:39:09.401Z","class":"CreatePipelineWorker","correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"23c0426c7d7244e6daf15e71d94c768e8374df0e","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"23c0426c7d7244e6daf15e71d94c768e8374df0e","ref":"refs/heads/master"},"retry":0}2199gitlab # [ 458.186295] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:09.439Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b39386f0d5d451f68c8238bf","created_at":"2026-09-09T10:39:03.425Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-f270a15807984d1c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e52e60665ac9f84e1115b8a1b8aefa3a28dc53576e4bbd2084ca91187ae9cd2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:03.437Z","job_size_bytes":467,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b39386f0d5d451f68c8238bf: done: 2.197718 sec","job_status":"done","queue_duration_s":3.803975,"scheduling_latency_s":3.804032,"gitaly_calls":7,"gitaly_duration_s":0.256535,"redis_calls":51,"redis_duration_s":0.051121,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.002048,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.019022,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.011817,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005578,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.092,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.082,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.585714,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002695035,"duration_s":2.197718,"completed_at":"2026-09-09T10:39:09.439Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.142551,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2200gitlab # [ 458.235944] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:09.446Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"a873d3e9-d2cf-4a6a-b9f1-2a598ff8345d\"}"],"class":"WebHookWorker","jid":"95b5dbbe18850074e63f604e","created_at":"2026-09-09T10:39:03.967Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-f270a15807984d1c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3fa5b5a562fe28fba20c2632000295b9ba4741fbb51fc1eec3ffb0a640cfe54c","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:03.992Z","job_size_bytes":1751,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-95b5dbbe18850074e63f604e: start","job_status":"start","queue_duration_s":5.454125,"scheduling_latency_s":5.454186}2201gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2202gitlab # [ 458.463431] nixbot[3042]: INFO: ::ffff:127.0.0.1:51176 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2203gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.08 seconds)2204gitlab # [ 458.581832] nixbot[3042]: INFO: ::ffff:127.0.0.1:51184 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2205gitlab # [ 458.644159] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:09.897Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"a873d3e9-d2cf-4a6a-b9f1-2a598ff8345d\"}"],"class":"WebHookWorker","jid":"95b5dbbe18850074e63f604e","created_at":"2026-09-09T10:39:03.967Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-f270a15807984d1c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3fa5b5a562fe28fba20c2632000295b9ba4741fbb51fc1eec3ffb0a640cfe54c","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:03.992Z","job_size_bytes":1751,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-95b5dbbe18850074e63f604e: done: 0.450775 sec","job_status":"done","queue_duration_s":5.454125,"scheduling_latency_s":5.454186,"redis_calls":19,"redis_duration_s":0.021271,"redis_read_bytes":32,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004391,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.002149,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.011638,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003093,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.11000755700001719,"cpu_s":0.170882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001073601,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.450775,"completed_at":"2026-09-09T10:39:09.896Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009646,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2206gitlab # [ 458.719717] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:09.900Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7bb47295f395540ed369b9aa","created_at":"2026-09-09T10:39:05.116Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.128Z","job_size_bytes":23,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7bb47295f395540ed369b9aa: start","job_status":"start","queue_duration_s":4.771749,"scheduling_latency_s":4.771813}2207gitlab # [ 458.761665] gitaly[863]: time="2026-09-09T10:39:10.015Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=6 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22W021S0SXPMQSHKVPAVY81 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:09.993" grpc.time_ms=21.563 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2208gitlab # [ 458.788091] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1342209gitlab # [ 458.902549] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:10.151Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7bb47295f395540ed369b9aa","created_at":"2026-09-09T10:39:05.116Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.128Z","job_size_bytes":23,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7bb47295f395540ed369b9aa: done: 0.250586 sec","job_status":"done","queue_duration_s":4.771749,"scheduling_latency_s":4.771813,"redis_calls":10,"redis_duration_s":0.011092,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000669,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005536,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004887,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003257956,"duration_s":0.250586,"completed_at":"2026-09-09T10:39:10.151Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.067131,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2210gitlab # [ 458.910465] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:10.162Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"fee17ecc6bf7743a7644dadd","created_at":"2026-09-09T10:39:05.520Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.533Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-fee17ecc6bf7743a7644dadd: start","job_status":"start","queue_duration_s":4.629047,"scheduling_latency_s":4.629104}2211gitlab # [ 459.081199] gitaly[863]: time="2026-09-09T10:39:10.333Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22W0263P8AYERS7FSHMF3ZD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:10.310" pid=863 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2212gitlab # [ 459.083494] gitaly[863]: time="2026-09-09T10:39:10.333Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0263P8AYERS7FSHMF3ZD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:10.310" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2213gitlab # [ 459.086196] gitlab-workhorse[823]: time="2026-09-09T10:39:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672214gitlab # [ 459.088178] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 3142215gitlab # [ 459.089555] gitaly[863]: time="2026-09-09T10:39:10.333Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0263P8AYERS7FSHMF3ZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:10.310" grpc.time_ms=22.917 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2216gitlab # [ 459.109271] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:10.360Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"fee17ecc6bf7743a7644dadd","created_at":"2026-09-09T10:39:05.520Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.533Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-fee17ecc6bf7743a7644dadd: done: 0.198189 sec","job_status":"done","queue_duration_s":4.629047,"scheduling_latency_s":4.629104,"redis_calls":10,"redis_duration_s":0.051237,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004946,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.041205,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005086,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002745042,"duration_s":0.198189,"completed_at":"2026-09-09T10:39:10.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2217gitlab # [ 459.216139] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:10.370Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0e64d7ed82e40956358d9d7a","created_at":"2026-09-09T10:39:05.562Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.576Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0e64d7ed82e40956358d9d7a: start","job_status":"start","queue_duration_s":4.794227,"scheduling_latency_s":4.79428}2218gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2219gitlab # [ 459.404966] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:10.656Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0e64d7ed82e40956358d9d7a","created_at":"2026-09-09T10:39:05.562Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.576Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0e64d7ed82e40956358d9d7a: done: 0.285887 sec","job_status":"done","queue_duration_s":4.794227,"scheduling_latency_s":4.79428,"redis_calls":10,"redis_duration_s":0.037593,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00086,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.034187,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002546,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.1,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.093,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003797131,"duration_s":0.285887,"completed_at":"2026-09-09T10:39:10.656Z","load_balancing_strategy":"primary","db_duration_s":0.096636,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2220gitlab # [ 459.513712] gitaly[863]: time="2026-09-09T10:39:10.767Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22W02PWTX27QBY8B6082G9K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:10.721" pid=863 remote_ip="2001:db8:1::1" request_sha=951c346def6271b49614d27c2484bcd118f3cd3b response_bytes=337 span.kind=server system=grpc2221gitlab # [ 459.548451] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:10.769Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0b5017d1c5fd48e7e3414022","created_at":"2026-09-09T10:39:05.600Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.614Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0b5017d1c5fd48e7e3414022: start","job_status":"start","queue_duration_s":5.152961,"scheduling_latency_s":5.153012}2222gitlab # [ 459.551197] gitlab-workhorse[823]: time="2026-09-09T10:39:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3372223gitlab # [ 459.554657] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 2182224gitlab # [ 459.554862] gitaly[863]: time="2026-09-09T10:39:10.771Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1188 command.oublock=0 command.real_time_ms=40 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22W02PWTX27QBY8B6082G9K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:10.721" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2225gitlab # [ 459.557689] nixbot[3042]: INFO: ::ffff:127.0.0.1:51190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2226gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.15 seconds)2227gitlab # [ 459.568094] gitaly[863]: time="2026-09-09T10:39:10.773Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1188 command.oublock=0 command.real_time_ms=40 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22W02PWTX27QBY8B6082G9K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:10.721" grpc.time_ms=51.671 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2228gitlab # [ 459.710326] nixbot[3042]: {"ts": "2026-09-09T10:39:10.963Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2229gitlab # [ 459.796511] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:11.046Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0b5017d1c5fd48e7e3414022","created_at":"2026-09-09T10:39:05.600Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.614Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0b5017d1c5fd48e7e3414022: done: 0.278834 sec","job_status":"done","queue_duration_s":5.152961,"scheduling_latency_s":5.153012,"redis_calls":13,"redis_duration_s":0.064265,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002606,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.027542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.007663,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.026454,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.044,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011957944,"duration_s":0.278834,"completed_at":"2026-09-09T10:39:11.046Z","load_balancing_strategy":"primary","db_duration_s":0.061073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2230gitlab # [ 459.901305] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:11.153Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c3e3876d5f8e3e6e4ba5eb44","created_at":"2026-09-09T10:39:05.615Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.631Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c3e3876d5f8e3e6e4ba5eb44: start","job_status":"start","queue_duration_s":5.522108,"scheduling_latency_s":5.52216}2231gitlab # [ 459.950190] gitaly[863]: time="2026-09-09T10:39:11.203Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W034X8HJKDAFWFSW1J88E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:41.201" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:11.201" grpc.time_ms=1.768 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2232gitlab # [ 460.182223] gitaly[863]: time="2026-09-09T10:39:11.435Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22W034X8HJKDAFWFSW1J88E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:21.057" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:11.418" grpc.time_ms=16.88 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2233gitlab # [ 460.209158] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:11.462Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c3e3876d5f8e3e6e4ba5eb44","created_at":"2026-09-09T10:39:05.615Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.631Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c3e3876d5f8e3e6e4ba5eb44: done: 0.308958 sec","job_status":"done","queue_duration_s":5.522108,"scheduling_latency_s":5.52216,"redis_calls":10,"redis_duration_s":0.037657,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.017378,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.017766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007068776,"duration_s":0.308958,"completed_at":"2026-09-09T10:39:11.461Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.07148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 460.301653] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:11.553Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"98545156c795e50c14fd16b2","created_at":"2026-09-09T10:39:05.632Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.644Z","job_size_bytes":19,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-98545156c795e50c14fd16b2: start","job_status":"start","queue_duration_s":5.909487,"scheduling_latency_s":5.909551}2235gitlab # [ 460.388799] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 6352236gitlab # [ 460.394351] nixbot[3042]: {"ts": "2026-09-09T10:39:11.647Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e \"HTTP/1.1 201 Created\""}2237gitlab # [ 460.511321] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:11.762Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"98545156c795e50c14fd16b2","created_at":"2026-09-09T10:39:05.632Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.644Z","job_size_bytes":19,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-98545156c795e50c14fd16b2: done: 0.209139 sec","job_status":"done","queue_duration_s":5.909487,"scheduling_latency_s":5.909551,"redis_calls":11,"redis_duration_s":0.037091,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.009646,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.022931,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001443759,"duration_s":0.209139,"completed_at":"2026-09-09T10:39:11.762Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.051733,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2238gitlab # [ 460.553566] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:11.806Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"aaff1e675b8b594f296c314b","created_at":"2026-09-09T10:39:05.649Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.661Z","job_size_bytes":66,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-aaff1e675b8b594f296c314b: start","job_status":"start","queue_duration_s":6.145267,"scheduling_latency_s":6.145341}2239gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2240gitlab # [ 460.648845] gitaly[863]: time="2026-09-09T10:39:11.902Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W03SBEM1KMMEGEV8XGTV7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:41.600" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:11.901" grpc.time_ms=1.001 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2241gitlab # [ 460.728664] nixbot[3042]: INFO: ::ffff:127.0.0.1:51198 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2242gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.10 seconds)2243gitlab # [ 460.760985] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:12.011Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"aaff1e675b8b594f296c314b","created_at":"2026-09-09T10:39:05.649Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.661Z","job_size_bytes":66,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-aaff1e675b8b594f296c314b: done: 0.204596 sec","job_status":"done","queue_duration_s":6.145267,"scheduling_latency_s":6.145341,"redis_calls":10,"redis_duration_s":0.030786,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004892,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.023817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002077,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.034,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005576128,"duration_s":0.204596,"completed_at":"2026-09-09T10:39:12.011Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044221,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2244gitlab # [ 460.800592] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:12.019Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"ad237e78c36f1448d32d7b6d","created_at":"2026-09-09T10:39:05.663Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.674Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ad237e78c36f1448d32d7b6d: start","job_status":"start","queue_duration_s":6.344367,"scheduling_latency_s":6.344419}2245gitlab # [ 460.870356] gitaly[863]: time="2026-09-09T10:39:12.123Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=61 command.spawn_token_fork_ms=52 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22W03SBEM1KMMEGEV8XGTV7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:22.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:12.060" grpc.time_ms=63.504 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2246gitlab # [ 461.038302] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 6322247gitlab # [ 461.051945] nixbot[3042]: {"ts": "2026-09-09T10:39:12.302Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e \"HTTP/1.1 201 Created\""}2248gitlab # [ 461.190468] gitaly[863]: time="2026-09-09T10:39:12.443Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W04E4VM7QSG61D5F07C13 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:42.041" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:12.442" grpc.time_ms=1.194 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2249gitlab # [ 461.316852] gitaly[863]: time="2026-09-09T10:39:12.570Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=11 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22W04E4VM7QSG61D5F07C13 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:22.182" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:12.543" grpc.time_ms=27.208 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2250gitlab # [ 461.350882] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:12.602Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"ad237e78c36f1448d32d7b6d","created_at":"2026-09-09T10:39:05.663Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.674Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ad237e78c36f1448d32d7b6d: done: 0.583449 sec","job_status":"done","queue_duration_s":6.344367,"scheduling_latency_s":6.344419,"redis_calls":10,"redis_duration_s":0.109037,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005194,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.090084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.013759,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.105,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.081,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001461359,"duration_s":0.583449,"completed_at":"2026-09-09T10:39:12.602Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.103167,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2251gitlab # [ 461.452992] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:12.706Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f9330d9f9db86f3d160479d6","created_at":"2026-09-09T10:39:05.696Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.706Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f9330d9f9db86f3d160479d6: start","job_status":"start","queue_duration_s":6.999986,"scheduling_latency_s":7.00011}2252gitlab # [ 461.466715] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3952253gitlab # [ 461.470882] nixbot[3042]: {"ts": "2026-09-09T10:39:12.720Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/23c0426c7d7244e6daf15e71d94c768e8374df0e \"HTTP/1.1 201 Created\""}2254gitlab # [ 461.582945] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:12.833Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f9330d9f9db86f3d160479d6","created_at":"2026-09-09T10:39:05.696Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.706Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f9330d9f9db86f3d160479d6: done: 0.127991 sec","job_status":"done","queue_duration_s":6.999986,"scheduling_latency_s":7.00011,"redis_calls":10,"redis_duration_s":0.0072180000000000005,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000926,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005182,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001884317,"duration_s":0.127991,"completed_at":"2026-09-09T10:39:12.833Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034172,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2255gitlab # [ 461.585688] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:12.837Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"bc96ba3192995bd08c78a86d","created_at":"2026-09-09T10:39:05.707Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.716Z","job_size_bytes":6,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-bc96ba3192995bd08c78a86d: start","job_status":"start","queue_duration_s":7.120625,"scheduling_latency_s":7.12067}2256gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2257gitlab # [ 461.694420] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:12.886Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"bc96ba3192995bd08c78a86d","created_at":"2026-09-09T10:39:05.707Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.716Z","job_size_bytes":6,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-bc96ba3192995bd08c78a86d: done: 0.049748 sec","job_status":"done","queue_duration_s":7.120625,"scheduling_latency_s":7.12067,"redis_calls":10,"redis_duration_s":0.003435,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000626,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001996,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000583873,"duration_s":0.049748,"completed_at":"2026-09-09T10:39:12.886Z","load_balancing_strategy":"primary","db_duration_s":0.006534,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2258gitlab # [ 461.728377] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:12.889Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"41c5f727d65af230d061c639","created_at":"2026-09-09T10:39:05.717Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.726Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-41c5f727d65af230d061c639: start","job_status":"start","queue_duration_s":7.163202,"scheduling_latency_s":7.163246}2259gitlab # [ 461.760567] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1302260gitlab # [ 461.764311] gitaly[863]: time="2026-09-09T10:39:12.923Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=5 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M22W04WW3CKV80P3WJN83RWZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:12.907" grpc.time_ms=15.903 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2261gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.13 seconds)2262gitlab # [ 461.785403] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:12.977Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"41c5f727d65af230d061c639","created_at":"2026-09-09T10:39:05.717Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.726Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-41c5f727d65af230d061c639: done: 0.088312 sec","job_status":"done","queue_duration_s":7.163202,"scheduling_latency_s":7.163246,"redis_calls":10,"redis_duration_s":0.006369,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000772,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004506,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000852622,"duration_s":0.088312,"completed_at":"2026-09-09T10:39:12.977Z","load_balancing_strategy":"primary","db_duration_s":0.015505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2263gitlab # [ 461.845644] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:12.983Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"2cd718edfc86deee05896acd","created_at":"2026-09-09T10:39:05.736Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.746Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-2cd718edfc86deee05896acd: start","job_status":"start","queue_duration_s":7.236723,"scheduling_latency_s":7.236775}2264gitlab # [ 461.970422] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:13.182Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"2cd718edfc86deee05896acd","created_at":"2026-09-09T10:39:05.736Z","trace_propagation_headers":{"sentry-trace":"5b0f92d185484246bbf4e8a14f6686f0-495b386b813a41e4","baggage":"sentry-trace_id=5b0f92d185484246bbf4e8a14f6686f0,sentry-release=Unknown"},"correlation_id":"01M22VVB4EJ3XEZECS3VAEVSFM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:05.746Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-2cd718edfc86deee05896acd: done: 0.198825 sec","job_status":"done","queue_duration_s":7.236723,"scheduling_latency_s":7.236775,"redis_calls":14,"redis_duration_s":0.012264,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000757,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005358,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001729828,"duration_s":0.198825,"completed_at":"2026-09-09T10:39:13.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044057,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2265gitlab # [ 462.048687] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:13.186Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d7cf45e1a2aa8c66ecb63ba4","created_at":"2026-09-09T10:39:06.110Z","trace_propagation_headers":{"sentry-trace":"11d6afd5899641918c5b6b73293077ed-2110b74396ca42c5","baggage":"sentry-trace_id=11d6afd5899641918c5b6b73293077ed,sentry-release=Unknown"},"correlation_id":"01M22VZKAQ14VTF170BVKAY02W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"6d6e90ff6a8f5264c0ebf226","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:06.117Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d7cf45e1a2aa8c66ecb63ba4: start","job_status":"start","queue_duration_s":7.069489,"scheduling_latency_s":7.069724}2266gitlab # [ 462.050772] nixbot[3042]: INFO: ::ffff:127.0.0.1:51202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2267gitlab # [ 462.052049] gitaly[863]: time="2026-09-09T10:39:13.268Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W diskcache=2185231f-b7d6-4f63-ba86-e68cd358fc1d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-09T16:39:13.244" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:13.245" pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2268gitlab # [ 462.053176] gitaly[863]: time="2026-09-09T10:39:13.269Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-09T16:39:13.244" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:13.245" grpc.time_ms=23.202 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2269gitlab # [ 462.054063] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:13.303Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d7cf45e1a2aa8c66ecb63ba4","created_at":"2026-09-09T10:39:06.110Z","trace_propagation_headers":{"sentry-trace":"11d6afd5899641918c5b6b73293077ed-2110b74396ca42c5","baggage":"sentry-trace_id=11d6afd5899641918c5b6b73293077ed,sentry-release=Unknown"},"correlation_id":"01M22VZKAQ14VTF170BVKAY02W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"6d6e90ff6a8f5264c0ebf226","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:06.117Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d7cf45e1a2aa8c66ecb63ba4: done: 0.117064 sec","job_status":"done","queue_duration_s":7.069489,"scheduling_latency_s":7.069724,"gitaly_calls":1,"gitaly_duration_s":0.028368,"redis_calls":12,"redis_duration_s":0.012081,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00246,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.004751,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00487,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06509291,"duration_s":0.117064,"completed_at":"2026-09-09T10:39:13.303Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2270gitlab # [ 462.120069] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:13.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"22aaf67201a0cf6d7559a293","created_at":"2026-09-09T10:39:06.390Z","trace_propagation_headers":{"sentry-trace":"11d6afd5899641918c5b6b73293077ed-2110b74396ca42c5","baggage":"sentry-trace_id=11d6afd5899641918c5b6b73293077ed,sentry-release=Unknown"},"correlation_id":"01M22VZKAQ14VTF170BVKAY02W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e01d432f503992c2a86890b9b614dc997c63e8ccbd2cccb33a7adff934289a04","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:06.401Z","job_size_bytes":467,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-22aaf67201a0cf6d7559a293: start","job_status":"start","queue_duration_s":6.908489,"scheduling_latency_s":6.908548}2271gitlab # [ 462.129966] gitaly[863]: time="2026-09-09T10:39:13.360Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:43.159" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:13.359" grpc.time_ms=1.007 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2272gitlab # [ 462.146814] gitaly[863]: time="2026-09-09T10:39:13.377Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-09T10:39:23.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:13.365" grpc.time_ms=11.636 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2273gitlab # [ 462.191875] gitaly[863]: time="2026-09-09T10:39:13.445Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:39:43.242" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:13.443" grpc.time_ms=1.313 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab # [ 462.214030] gitaly[863]: time="2026-09-09T10:39:13.466Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=5 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=5 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=324 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-09T10:39:43.252" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:13.453" grpc.time_ms=12.61 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2275gitlab # [ 462.300690] gitaly[863]: time="2026-09-09T10:39:13.554Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22W0513W45VJJQN8PB7S876 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:13.075" pid=863 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2276gitlab # [ 462.321844] gitaly[863]: time="2026-09-09T10:39:13.554Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=475 command.spawn_token_fork_ms=460 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0513W45VJJQN8PB7S876 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:13.075" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2277gitlab # [ 462.327183] gitlab-workhorse[823]: time="2026-09-09T10:39:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672278gitlab # [ 462.329099] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 6242279gitlab # [ 462.329897] gitaly[863]: time="2026-09-09T10:39:13.554Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=475 command.spawn_token_fork_ms=460 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0513W45VJJQN8PB7S876 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:13.075" grpc.time_ms=479.755 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2280gitlab # [ 462.389845] gitaly[863]: time="2026-09-09T10:39:13.643Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=86 command.spawn_token_fork_ms=7 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:23.191" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:13.552" grpc.time_ms=91.198 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2281gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2282gitlab # [ 462.914336] nixbot[3042]: INFO: ::ffff:127.0.0.1:51212 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2283gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.07 seconds)2284gitlab # [ 463.321475] gitaly[863]: time="2026-09-09T10:39:14.574Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=1 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=6 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-09T10:39:44.351" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:14.551" grpc.time_ms=21.52 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2285gitlab # [ 463.370212] gitaly[863]: time="2026-09-09T10:39:14.623Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22VZKAQ14VTF170BVKAY02W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-09T10:39:44.401" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:14.602" grpc.time_ms=21.67 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2286gitlab # [ 463.433341] sidekiq-cluster[2922]: {"severity":"WARN","time":"2026-09-09T10:39:14.683Z","class":"CreatePipelineWorker","correlation_id":"01M22VZKAQ14VTF170BVKAY02W","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"23c0426c7d7244e6daf15e71d94c768e8374df0e","after":"31a0e91e37b3d59648d358ba62ce24822d73dead","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"31a0e91e37b3d59648d358ba62ce24822d73dead","ref":"refs/heads/master"},"retry":0}2287gitlab # [ 463.449222] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:14.700Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"22aaf67201a0cf6d7559a293","created_at":"2026-09-09T10:39:06.390Z","trace_propagation_headers":{"sentry-trace":"11d6afd5899641918c5b6b73293077ed-2110b74396ca42c5","baggage":"sentry-trace_id=11d6afd5899641918c5b6b73293077ed,sentry-release=Unknown"},"correlation_id":"01M22VZKAQ14VTF170BVKAY02W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e01d432f503992c2a86890b9b614dc997c63e8ccbd2cccb33a7adff934289a04","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:06.401Z","job_size_bytes":467,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-22aaf67201a0cf6d7559a293: done: 1.391107 sec","job_status":"done","queue_duration_s":6.908489,"scheduling_latency_s":6.908548,"gitaly_calls":7,"gitaly_duration_s":0.251273,"redis_calls":33,"redis_duration_s":0.027805999999999997,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001448,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002423,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.021903,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002032,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.99373,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.391107,"completed_at":"2026-09-09T10:39:14.700Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04412,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2288gitlab # [ 463.514333] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:14.709Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"7ce38a84-ab45-4a2f-92c7-301a6946ac2a\"}"],"class":"WebHookWorker","jid":"c84b881dd6ce4d3825a6979d","created_at":"2026-09-09T10:39:06.427Z","trace_propagation_headers":{"sentry-trace":"11d6afd5899641918c5b6b73293077ed-2110b74396ca42c5","baggage":"sentry-trace_id=11d6afd5899641918c5b6b73293077ed,sentry-release=Unknown"},"correlation_id":"01M22VZKAQ14VTF170BVKAY02W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3b0d94af452aa2bb6644ce67351e1ae0c395d6ccfc14e0b2d98b146adfc94552","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:06.430Z","job_size_bytes":1749,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c84b881dd6ce4d3825a6979d: start","job_status":"start","queue_duration_s":8.278828,"scheduling_latency_s":8.278884}2289gitlab # [ 463.571312] nixbot[3042]: INFO: ::ffff:127.0.0.1:39840 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2290gitlab # [ 463.596453] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:14.849Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"7ce38a84-ab45-4a2f-92c7-301a6946ac2a\"}"],"class":"WebHookWorker","jid":"c84b881dd6ce4d3825a6979d","created_at":"2026-09-09T10:39:06.427Z","trace_propagation_headers":{"sentry-trace":"11d6afd5899641918c5b6b73293077ed-2110b74396ca42c5","baggage":"sentry-trace_id=11d6afd5899641918c5b6b73293077ed,sentry-release=Unknown"},"correlation_id":"01M22VZKAQ14VTF170BVKAY02W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3b0d94af452aa2bb6644ce67351e1ae0c395d6ccfc14e0b2d98b146adfc94552","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:06.430Z","job_size_bytes":1749,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c84b881dd6ce4d3825a6979d: done: 0.139821 sec","job_status":"done","queue_duration_s":8.278828,"scheduling_latency_s":8.278884,"redis_calls":14,"redis_duration_s":0.007198,"redis_read_bytes":26,"redis_write_bytes":4682,"redis_queues_calls":2,"redis_queues_duration_s":0.000634,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3726,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004074,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00249,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.018075482000028842,"cpu_s":0.057919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.139821,"completed_at":"2026-09-09T10:39:14.849Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2291gitlab # [ 463.674210] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:14.927Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a4d15c22f976de51a5b85a2b","created_at":"2026-09-09T10:39:06.644Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-48e3ffe1bab44f6d","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:06.658Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a4d15c22f976de51a5b85a2b: start","job_status":"start","queue_duration_s":8.269256,"scheduling_latency_s":8.269308}2292gitlab # [ 463.730513] gitaly[863]: time="2026-09-09T10:39:14.984Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22W06XC4QSZ8NGRKF3SZGGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:14.972" grpc.time_ms=11.22 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2293gitlab # [ 463.733496] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1262294gitlab # [ 463.825875] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.079Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a4d15c22f976de51a5b85a2b","created_at":"2026-09-09T10:39:06.644Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-48e3ffe1bab44f6d","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:06.658Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a4d15c22f976de51a5b85a2b: done: 0.151637 sec","job_status":"done","queue_duration_s":8.269256,"scheduling_latency_s":8.269308,"redis_calls":19,"redis_duration_s":0.015032,"redis_read_bytes":22,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002934,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.004772,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.005265,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002061,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.03035749,"duration_s":0.151637,"completed_at":"2026-09-09T10:39:15.078Z","load_balancing_strategy":"primary","db_duration_s":0.018468,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2295gitlab # [ 463.893731] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.146Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","95b5dbbe18850074e63f604e"],"class":"WebHooks::LogExecutionWorker","jid":"3db4391f640a509be36c4e39","created_at":"2026-09-09T10:39:09.846Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-6c91dd2efd8d463c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8101c26f4e85d779ec5a10806a684b5feada898075033e02d25c705a3e99c8f9","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:09.872Z","job_size_bytes":2592,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3db4391f640a509be36c4e39: start","job_status":"start","queue_duration_s":5.274174,"scheduling_latency_s":5.274246}2296gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2297gitlab # [ 463.918687] gitaly[863]: time="2026-09-09T10:39:15.172Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22W071D605J3AMH7YEFV80B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:15.160" pid=863 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2298gitlab # [ 463.919354] gitaly[863]: time="2026-09-09T10:39:15.172Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M22W071D605J3AMH7YEFV80B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:15.160" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2299gitlab # [ 463.920935] gitaly[863]: time="2026-09-09T10:39:15.173Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M22W071D605J3AMH7YEFV80B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:15.160" grpc.time_ms=11.876 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2300gitlab # [ 463.922171] gitlab-workhorse[823]: time="2026-09-09T10:39:15Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672301gitlab # [ 463.923301] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:15 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1842302gitlab # [ 464.008557] nixbot[3042]: INFO: ::ffff:127.0.0.1:39846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2303gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.08 seconds)2304gitlab # [ 464.017053] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.268Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","95b5dbbe18850074e63f604e"],"class":"WebHooks::LogExecutionWorker","jid":"3db4391f640a509be36c4e39","created_at":"2026-09-09T10:39:09.846Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-6c91dd2efd8d463c","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8101c26f4e85d779ec5a10806a684b5feada898075033e02d25c705a3e99c8f9","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:09.872Z","job_size_bytes":2592,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3db4391f640a509be36c4e39: done: 0.122416 sec","job_status":"done","queue_duration_s":5.274174,"scheduling_latency_s":5.274246,"redis_calls":10,"redis_duration_s":0.005559,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001583,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002911,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000581359,"duration_s":0.122416,"completed_at":"2026-09-09T10:39:15.268Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2305gitlab # [ 464.019414] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.271Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"546c5fea439fe2033f0905c3","created_at":"2026-09-09T10:39:10.324Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f944cd4840a8bd5abf2a3244525a4938","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:10.427Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-546c5fea439fe2033f0905c3: start","job_status":"start","queue_duration_s":4.844125,"scheduling_latency_s":4.844167}2306gitlab # [ 464.084501] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"546c5fea439fe2033f0905c3","created_at":"2026-09-09T10:39:10.324Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f944cd4840a8bd5abf2a3244525a4938","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:10.427Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-546c5fea439fe2033f0905c3: done: 0.064083 sec","job_status":"done","queue_duration_s":4.844125,"scheduling_latency_s":4.844167,"redis_calls":9,"redis_duration_s":0.011783,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004601,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.064083,"completed_at":"2026-09-09T10:39:15.335Z","load_balancing_strategy":"primary","db_duration_s":0.011748,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2307gitlab # [ 464.096257] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"faf55d3609bbad6056b3f698","created_at":"2026-09-09T10:39:10.463Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4e56ee19ebf7859117e7920ed60b6a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:10.538Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-faf55d3609bbad6056b3f698: start","job_status":"start","queue_duration_s":4.79989,"scheduling_latency_s":4.799934}2308gitlab # [ 464.143359] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"faf55d3609bbad6056b3f698","created_at":"2026-09-09T10:39:10.463Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4e56ee19ebf7859117e7920ed60b6a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:10.538Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-faf55d3609bbad6056b3f698: done: 0.058071 sec","job_status":"done","queue_duration_s":4.79989,"scheduling_latency_s":4.799934,"redis_calls":11,"redis_duration_s":0.009843,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002154,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002595,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005094,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001453258,"exclusive_lock_hold_duration_s":0.015199139,"duration_s":0.058071,"completed_at":"2026-09-09T10:39:15.396Z","load_balancing_strategy":"primary","db_duration_s":0.010272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2309gitlab # [ 464.212118] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.399Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6cbe1e14c1822b627645acc1","created_at":"2026-09-09T10:39:10.616Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dedcf94c66e89ecec31fb7ae051d8877","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:39:10.764Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6cbe1e14c1822b627645acc1: start","job_status":"start","queue_duration_s":4.634924,"scheduling_latency_s":4.634967}2310gitlab # [ 464.213392] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.418Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2311gitlab # [ 464.214415] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.430Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6cbe1e14c1822b627645acc1","created_at":"2026-09-09T10:39:10.616Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dedcf94c66e89ecec31fb7ae051d8877","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:39:10.764Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6cbe1e14c1822b627645acc1: done: 0.030667 sec","job_status":"done","queue_duration_s":4.634924,"scheduling_latency_s":4.634967,"redis_calls":9,"redis_duration_s":0.003607,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000686,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002018,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030667,"completed_at":"2026-09-09T10:39:15.430Z","load_balancing_strategy":"primary","db_duration_s":0.000817,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2312gitlab # [ 464.295241] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.432Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ad6a48e5526477aa4983f0b2","created_at":"2026-09-09T10:39:10.803Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"591cd2145b6eb7749ccb77ac493057da","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:10.835Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ad6a48e5526477aa4983f0b2: start","job_status":"start","queue_duration_s":4.597177,"scheduling_latency_s":4.59722}2313gitlab # [ 464.296210] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ad6a48e5526477aa4983f0b2","created_at":"2026-09-09T10:39:10.803Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"591cd2145b6eb7749ccb77ac493057da","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:10.835Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ad6a48e5526477aa4983f0b2: done: 0.103946 sec","job_status":"done","queue_duration_s":4.597177,"scheduling_latency_s":4.59722,"redis_calls":11,"redis_duration_s":0.005233,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000821,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00227,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00161948,"exclusive_lock_hold_duration_s":0.050247168,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.103946,"completed_at":"2026-09-09T10:39:15.536Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2314gitlab # [ 464.334541] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a58858206fb03e7f0c7aa515","created_at":"2026-09-09T10:39:10.847Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3cc69cd7da6a99ca085167b3b1e9d39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:10.895Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a58858206fb03e7f0c7aa515: start","job_status":"start","queue_duration_s":4.646141,"scheduling_latency_s":4.646199}2315gitlab # [ 464.417657] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.578Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2316gitlab # [ 464.419263] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a58858206fb03e7f0c7aa515","created_at":"2026-09-09T10:39:10.847Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3cc69cd7da6a99ca085167b3b1e9d39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:10.895Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a58858206fb03e7f0c7aa515: done: 0.053288 sec","job_status":"done","queue_duration_s":4.646141,"scheduling_latency_s":4.646199,"redis_calls":9,"redis_duration_s":0.004844,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000941,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002885,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053288,"completed_at":"2026-09-09T10:39:15.594Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001041,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2317gitlab # [ 464.497936] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9f7500b344a646a60b0453a6","created_at":"2026-09-09T10:39:10.905Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d385425f9b518fa02c6f1edcc47ff468","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:39:10.931Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9f7500b344a646a60b0453a6: start","job_status":"start","queue_duration_s":4.667655,"scheduling_latency_s":4.66771}2318gitlab # [ 464.500458] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.635Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2319gitlab # [ 464.502826] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9f7500b344a646a60b0453a6","created_at":"2026-09-09T10:39:10.905Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d385425f9b518fa02c6f1edcc47ff468","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:39:10.931Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9f7500b344a646a60b0453a6: done: 0.05483 sec","job_status":"done","queue_duration_s":4.667655,"scheduling_latency_s":4.66771,"redis_calls":9,"redis_duration_s":0.015763,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001196,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002788,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05483,"completed_at":"2026-09-09T10:39:15.653Z","load_balancing_strategy":"primary","db_duration_s":0.000866,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2320gitlab # [ 464.585646] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:15.659Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d24caeee303a9c8bc32a26ed","created_at":"2026-09-09T10:39:10.957Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d989ffd87b743147dedd5ef1afa5636","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:10.995Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d24caeee303a9c8bc32a26ed: start","job_status":"start","queue_duration_s":4.664054,"scheduling_latency_s":4.664104}2321gitlab # [ 464.799289] gitaly[863]: time="2026-09-09T10:39:16.052Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22W07Y8N1R705K8D3YNFCPD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:16.040" grpc.time_ms=12.224 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2322gitlab # [ 464.817343] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:16 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1402323gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2324gitlab # [ 465.023830] gitaly[863]: time="2026-09-09T10:39:16.274Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22W0833RJS7PS5NCA7EJY05 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:16.228" pid=863 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2325gitlab # [ 465.025079] gitlab-workhorse[823]: time="2026-09-09T10:39:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162326gitlab # [ 465.025956] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:16 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 2092327gitlab # [ 465.026774] gitaly[863]: time="2026-09-09T10:39:16.274Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=42 command.spawn_token_fork_ms=11 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0833RJS7PS5NCA7EJY05 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:16.228" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2328gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.06 seconds)2329gitlab # [ 465.029298] gitaly[863]: time="2026-09-09T10:39:16.275Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=42 command.spawn_token_fork_ms=11 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0833RJS7PS5NCA7EJY05 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:39:16.228" grpc.time_ms=46.212 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc2330gitlab # [ 465.062608] nixbot[3042]: INFO: ::ffff:127.0.0.1:39860 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2331gitlab # [ 465.196138] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:16.448Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d24caeee303a9c8bc32a26ed","created_at":"2026-09-09T10:39:10.957Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d989ffd87b743147dedd5ef1afa5636","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:10.995Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d24caeee303a9c8bc32a26ed: done: 0.789273 sec","job_status":"done","queue_duration_s":4.664054,"scheduling_latency_s":4.664104,"redis_calls":13,"redis_duration_s":0.016586,"redis_read_bytes":11,"redis_write_bytes":1563,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.007149,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005576,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003861,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.162,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.16,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.44191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001258261,"exclusive_lock_hold_duration_s":0.711036738,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.789273,"completed_at":"2026-09-09T10:39:16.448Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.255063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2332gitlab # [ 465.284446] gitaly[863]: time="2026-09-09T10:39:16.538Z" level=info msg="finished unary call with code OK" catfile.duration_ms=14 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=14 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:46.222" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:16.523" grpc.time_ms=14.648 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2333gitlab # [ 465.293821] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:16.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a77e74f414cd5ae8554b268d","created_at":"2026-09-09T10:39:11.011Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cc2c587333e3d66bedbd03504da76f6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.148Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a77e74f414cd5ae8554b268d: start","job_status":"start","queue_duration_s":5.395373,"scheduling_latency_s":5.395433}2334gitlab # [ 465.354310] gitaly[863]: time="2026-09-09T10:39:16.607Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-09T10:39:46.295" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:16.596" grpc.time_ms=11.807 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2335gitlab # [ 465.378338] gitaly[863]: time="2026-09-09T10:39:16.630Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:26.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:16.618" grpc.time_ms=11.718 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab # [ 465.456345] gitaly[863]: time="2026-09-09T10:39:16.710Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-09T10:39:26.098" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:39:16.709" grpc.time_ms=0.838 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2337gitlab # [ 465.517647] gitaly[863]: time="2026-09-09T10:39:16.771Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-09T10:39:26.150" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:16.760" grpc.time_ms=10.469 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2338gitlab # [ 465.595982] gitaly[863]: time="2026-09-09T10:39:16.849Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:39:16.848" grpc.time_ms=0.729 pid=863 span.kind=server system=grpc2339gitlab # [ 465.659659] gitaly[863]: time="2026-09-09T10:39:16.913Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:39:16.912" grpc.time_ms=0.728 pid=863 span.kind=server system=grpc2340gitlab # [ 465.710501] gitaly[863]: time="2026-09-09T10:39:16.964Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS diskcache=84465863-52b3-4b74-b57b-cc698a6dba9c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:39:26.165" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:39:16.776" pid=863 ref=refs/keep-around/31a0e91e37b3d59648d358ba62ce24822d73dead remote_ip="2001:db8:1::1" revision=31a0e91e37b3d59648d358ba62ce24822d73dead span.kind=server system=grpc username=root2341gitlab # [ 465.734202] gitaly[863]: time="2026-09-09T10:39:16.964Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=87 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5279 command.oublock=8 command.real_time_ms=165 command.spawn_token_fork_ms=6 command.system_time_ms=44 command.user_time_ms=43 component=gitaly.UnaryServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:39:26.165" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:39:16.776" grpc.time_ms=188.157 pid=863 ref=refs/keep-around/31a0e91e37b3d59648d358ba62ce24822d73dead remote_ip="2001:db8:1::1" revision=31a0e91e37b3d59648d358ba62ce24822d73dead span.kind=server system=grpc username=root2342gitlab # [ 465.757429] gitaly[863]: time="2026-09-09T10:39:16.978Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:46.877" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:16.977" grpc.time_ms=0.796 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2343gitlab # [ 465.934677] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 7922344gitlab # [ 465.944978] nixbot[3042]: {"ts": "2026-09-09T10:39:17.198Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31a0e91e37b3d59648d358ba62ce24822d73dead \"HTTP/1.1 201 Created\""}2345gitlab # [ 465.973557] nixbot[3042]: {"ts": "2026-09-09T10:39:17.227Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-31a0e91e37b3-5"}2346gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead'2347gitlab # [ 466.113462] nixbot[3042]: INFO: ::ffff:127.0.0.1:39870 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 200 OK2348gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31a0e91e37b3d59648d358ba62ce24822d73dead', in 0.05 seconds)2349(finished: subtest: push delivers the webhook, in 164.78 seconds)2350subtest: eval and build post commit statuses2351gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses2352gitlab # [ 466.181490] nixbot[3042]: {"ts": "2026-09-09T10:39:17.435Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-31a0e91e37b3-5", "argv0": "bwrap"}2353gitlab # [ 466.288420] gitaly[863]: time="2026-09-09T10:39:17.541Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W09CZK1KQ2SECGKBBMDX6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:47.139" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:17.540" grpc.time_ms=0.849 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2354gitlab # [ 466.303066] nix-daemon[3220]: accepted connection from pid 4724, user nixbot2355gitlab # [ 466.376295] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2212356gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses, in 0.28 seconds)2357gitlab # [ 466.388734] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:17.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a77e74f414cd5ae8554b268d","created_at":"2026-09-09T10:39:11.011Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cc2c587333e3d66bedbd03504da76f6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.148Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a77e74f414cd5ae8554b268d: done: 1.092254 sec","job_status":"done","queue_duration_s":5.395373,"scheduling_latency_s":5.395433,"redis_calls":564,"redis_duration_s":0.322421,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003394,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.318434,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.76369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.092254,"completed_at":"2026-09-09T10:39:17.635Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000739,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2358gitlab # [ 466.467786] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:17.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"43866e8c0d78ac09f529a770","created_at":"2026-09-09T10:39:11.244Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"500f9bf576192bd560c5af070e43b01c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.276Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-43866e8c0d78ac09f529a770: start","job_status":"start","queue_duration_s":6.364408,"scheduling_latency_s":6.364458}2359gitlab # [ 466.493882] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:17.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"43866e8c0d78ac09f529a770","created_at":"2026-09-09T10:39:11.244Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"500f9bf576192bd560c5af070e43b01c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.276Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-43866e8c0d78ac09f529a770: done: 0.079653 sec","job_status":"done","queue_duration_s":6.364408,"scheduling_latency_s":6.364458,"redis_calls":9,"redis_duration_s":0.008989,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005559,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002155,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079653,"completed_at":"2026-09-09T10:39:17.720Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006694,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2360gitlab # [ 466.496252] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:17.728Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f502c6dfd22f58831af53a9c","created_at":"2026-09-09T10:39:11.298Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5328876cca931430e8d2659d02d727e2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.338Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f502c6dfd22f58831af53a9c: start","job_status":"start","queue_duration_s":6.389425,"scheduling_latency_s":6.389517}2361gitlab # [ 466.586107] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:17.839Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f502c6dfd22f58831af53a9c","created_at":"2026-09-09T10:39:11.298Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5328876cca931430e8d2659d02d727e2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.338Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f502c6dfd22f58831af53a9c: done: 0.11117 sec","job_status":"done","queue_duration_s":6.389425,"scheduling_latency_s":6.389517,"redis_calls":11,"redis_duration_s":0.033209,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004461,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.018733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.010015,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.11117,"completed_at":"2026-09-09T10:39:17.838Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002853,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2362gitlab # [ 466.592491] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:17.843Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"233a0e6bf387401ef4fa14ca","created_at":"2026-09-09T10:39:11.389Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e57a5f31b39bd2fd6cec9914303f9ec","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.404Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-233a0e6bf387401ef4fa14ca: start","job_status":"start","queue_duration_s":6.439408,"scheduling_latency_s":6.439459}2363gitlab # [ 466.721104] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:17.970Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"233a0e6bf387401ef4fa14ca","created_at":"2026-09-09T10:39:11.389Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e57a5f31b39bd2fd6cec9914303f9ec","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.404Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-233a0e6bf387401ef4fa14ca: done: 0.125826 sec","job_status":"done","queue_duration_s":6.439408,"scheduling_latency_s":6.439459,"redis_calls":12,"redis_duration_s":0.018630999999999998,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006465,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00862,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003546,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.028654759,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.125826,"completed_at":"2026-09-09T10:39:17.969Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014083,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2364gitlab # [ 466.822922] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:18.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"44fc431f49a7971206993f88","created_at":"2026-09-09T10:39:11.421Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b89fc95e98348a67b6c8f053bd2ffa33","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.586Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-44fc431f49a7971206993f88: start","job_status":"start","queue_duration_s":6.486074,"scheduling_latency_s":6.486127}2365gitlab # [ 466.952250] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:18.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"44fc431f49a7971206993f88","created_at":"2026-09-09T10:39:11.421Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b89fc95e98348a67b6c8f053bd2ffa33","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.586Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-44fc431f49a7971206993f88: done: 0.129241 sec","job_status":"done","queue_duration_s":6.486074,"scheduling_latency_s":6.486127,"redis_calls":11,"redis_duration_s":0.011428,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002884,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003769,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00179101,"exclusive_lock_hold_duration_s":0.009908522,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.129241,"completed_at":"2026-09-09T10:39:18.201Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2366gitlab # [ 467.029878] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:18.279Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e25c1c17c4cc55f75d6336a7","created_at":"2026-09-09T10:39:11.560Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-3b0093aeba9346b9","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.592Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e25c1c17c4cc55f75d6336a7: start","job_status":"start","queue_duration_s":6.686539,"scheduling_latency_s":6.686602}2367gitlab # [ 467.318267] gitaly[863]: time="2026-09-09T10:39:18.570Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22W034X8HJKDAFWFSW1J88E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:39:18.569" grpc.time_ms=0.999 pid=863 span.kind=server system=grpc2368gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses2369gitlab # [ 467.391121] gitaly[863]: time="2026-09-09T10:39:18.644Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22W034X8HJKDAFWFSW1J88E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:39:18.643" grpc.time_ms=0.929 pid=863 span.kind=server system=grpc2370gitlab # [ 467.456564] gitaly[863]: time="2026-09-09T10:39:18.710Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22W034X8HJKDAFWFSW1J88E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:39:18.709" grpc.time_ms=0.766 pid=863 span.kind=server system=grpc2371gitlab # [ 467.530669] gitaly[863]: time="2026-09-09T10:39:18.784Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22W034X8HJKDAFWFSW1J88E diskcache=c26400eb-ea96-43ac-99e3-edb785c413e4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:39:48.323" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:18.523" pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2372gitlab # [ 467.551247] gitaly[863]: time="2026-09-09T10:39:18.785Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=177 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7292 command.oublock=0 command.real_time_ms=241 command.spawn_token_fork_ms=2 command.system_time_ms=120 command.user_time_ms=57 component=gitaly.UnaryServerInterceptor correlation_id=01M22W034X8HJKDAFWFSW1J88E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:39:48.323" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:18.523" grpc.time_ms=260.695 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2373gitlab # [ 467.580837] gitaly[863]: time="2026-09-09T10:39:18.834Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0ANJGRQEKS9RQFYNDMT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:48.732" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:18.833" grpc.time_ms=0.893 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2374gitlab # [ 467.675560] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2212375gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses, in 0.28 seconds)2376gitlab # [ 467.731509] gitaly[863]: time="2026-09-09T10:39:18.985Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22W034X8HJKDAFWFSW1J88E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:39:48.783" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:18.983" grpc.time_ms=1.176 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2377gitlab # [ 467.803824] gitaly[863]: time="2026-09-09T10:39:19.054Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W034X8HJKDAFWFSW1J88E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:49.052" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:19.053" grpc.time_ms=0.953 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2378gitlab # [ 467.845889] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.098Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e25c1c17c4cc55f75d6336a7","created_at":"2026-09-09T10:39:11.560Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-3b0093aeba9346b9","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.592Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2922,"job_status":"rescheduled","message":"PipelineProcessWorker JID-e25c1c17c4cc55f75d6336a7: rescheduled"}2379gitlab # [ 468.118339] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.371Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e25c1c17c4cc55f75d6336a7","created_at":"2026-09-09T10:39:11.560Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-3b0093aeba9346b9","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.592Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e25c1c17c4cc55f75d6336a7: done: 1.091906 sec","job_status":"done","queue_duration_s":6.686539,"scheduling_latency_s":6.686602,"gitaly_calls":3,"gitaly_duration_s":0.282219,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.307589,"redis_read_bytes":155,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.001681,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001785,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.116269,"redis_queues_read_bytes":33,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.155194,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000672,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001252,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.029055,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.106,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.022,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.022,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.06,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.338453,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.677680264,"duration_s":1.091906,"completed_at":"2026-09-09T10:39:19.370Z","load_balancing_strategy":"primary","db_duration_s":0.110032,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2380gitlab # [ 468.190767] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.443Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9184465198e671824b44deff","created_at":"2026-09-09T10:39:11.625Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.670Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9184465198e671824b44deff: start","job_status":"start","queue_duration_s":7.773552,"scheduling_latency_s":7.773608}2381gitlab # [ 468.375868] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9184465198e671824b44deff","created_at":"2026-09-09T10:39:11.625Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.670Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9184465198e671824b44deff: done: 0.185115 sec","job_status":"done","queue_duration_s":7.773552,"scheduling_latency_s":7.773608,"redis_calls":62,"redis_duration_s":0.035384,"redis_read_bytes":110,"redis_write_bytes":41440,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001012,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_calls":2,"redis_queues_duration_s":0.001008,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.028057,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.005307,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.123313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.185115,"completed_at":"2026-09-09T10:39:19.628Z","load_balancing_strategy":"primary","db_duration_s":0.003968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 468.378406] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"534e4939ec036c7f44a6e8c9","created_at":"2026-09-09T10:39:11.717Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33442045797c779a8d05e022b2d63c2b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:39:11.743Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-534e4939ec036c7f44a6e8c9: start","job_status":"start","queue_duration_s":7.888582,"scheduling_latency_s":7.888632}2383gitlab # [ 468.472208] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.723Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"534e4939ec036c7f44a6e8c9","created_at":"2026-09-09T10:39:11.717Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33442045797c779a8d05e022b2d63c2b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:39:11.743Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-534e4939ec036c7f44a6e8c9: done: 0.091564 sec","job_status":"done","queue_duration_s":7.888582,"scheduling_latency_s":7.888632,"redis_calls":9,"redis_duration_s":0.010002,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001365,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007618,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.091564,"completed_at":"2026-09-09T10:39:19.723Z","load_balancing_strategy":"primary","db_duration_s":0.009046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 468.561307] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.814Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b5e96b5e33eca50c61c59889","created_at":"2026-09-09T10:39:11.797Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc99f74968a37b094fd86f66b0762d11","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.818Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b5e96b5e33eca50c61c59889: start","job_status":"start","queue_duration_s":7.995607,"scheduling_latency_s":7.995669}2385gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses2386gitlab # [ 468.651538] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.904Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b5e96b5e33eca50c61c59889","created_at":"2026-09-09T10:39:11.797Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc99f74968a37b094fd86f66b0762d11","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.818Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b5e96b5e33eca50c61c59889: done: 0.090295 sec","job_status":"done","queue_duration_s":7.995607,"scheduling_latency_s":7.995669,"redis_calls":9,"redis_duration_s":0.009474,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000952,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007334,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001188,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090295,"completed_at":"2026-09-09T10:39:19.904Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2387gitlab # [ 468.667969] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.915Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"435b5c53def877470436b599","created_at":"2026-09-09T10:39:11.861Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d57cd664d930b1fd7c539f3486e43f67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.894Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-435b5c53def877470436b599: start","job_status":"start","queue_duration_s":8.020565,"scheduling_latency_s":8.020622}2388gitlab # [ 468.705503] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.958Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2389gitlab # [ 468.722736] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.974Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"435b5c53def877470436b599","created_at":"2026-09-09T10:39:11.861Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d57cd664d930b1fd7c539f3486e43f67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.894Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-435b5c53def877470436b599: done: 0.059452 sec","job_status":"done","queue_duration_s":8.020565,"scheduling_latency_s":8.020622,"redis_calls":9,"redis_duration_s":0.016122,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008331,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003397,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004394,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059452,"completed_at":"2026-09-09T10:39:19.974Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002202,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 468.756606] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:19.985Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6c417eaa216335257985e072","created_at":"2026-09-09T10:39:11.934Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"705721a22de5e1bf48d00b8c03300f75","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.998Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6c417eaa216335257985e072: start","job_status":"start","queue_duration_s":7.986575,"scheduling_latency_s":7.986632}2391gitlab # [ 468.824887] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.013Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2392gitlab # [ 468.825801] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6c417eaa216335257985e072","created_at":"2026-09-09T10:39:11.934Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"705721a22de5e1bf48d00b8c03300f75","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:11.998Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6c417eaa216335257985e072: done: 0.040678 sec","job_status":"done","queue_duration_s":7.986575,"scheduling_latency_s":7.986632,"redis_calls":9,"redis_duration_s":0.003385,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000721,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000861,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040678,"completed_at":"2026-09-09T10:39:20.025Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2393gitlab # [ 468.845125] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f0b5fe3399af2843656ae47a","created_at":"2026-09-09T10:39:12.004Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74d6501871a4d432280362980942d8d9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:12.026Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f0b5fe3399af2843656ae47a: start","job_status":"start","queue_duration_s":8.00235,"scheduling_latency_s":8.002395}2394gitlab # [ 468.865963] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.064Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2395gitlab # [ 468.870369] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f0b5fe3399af2843656ae47a","created_at":"2026-09-09T10:39:12.004Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74d6501871a4d432280362980942d8d9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:12.026Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f0b5fe3399af2843656ae47a: done: 0.052184 sec","job_status":"done","queue_duration_s":8.00235,"scheduling_latency_s":8.002395,"redis_calls":9,"redis_duration_s":0.009896,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003802,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00457,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001524,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052184,"completed_at":"2026-09-09T10:39:20.081Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001055,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2396gitlab # [ 468.956601] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8fd78f88e34b255660d92622","created_at":"2026-09-09T10:39:12.116Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c788aff11164cc8708ce13cf260af131","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:12.171Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8fd78f88e34b255660d92622: start","job_status":"start","queue_duration_s":7.914307,"scheduling_latency_s":7.914358}2397gitlab # [ 468.957856] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8fd78f88e34b255660d92622","created_at":"2026-09-09T10:39:12.116Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c788aff11164cc8708ce13cf260af131","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:12.171Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8fd78f88e34b255660d92622: done: 0.10612 sec","job_status":"done","queue_duration_s":7.914307,"scheduling_latency_s":7.914358,"redis_calls":11,"redis_duration_s":0.013489000000000001,"redis_read_bytes":9,"redis_write_bytes":1509,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001608,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007585,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00535068,"exclusive_lock_hold_duration_s":0.04124351,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.10612,"completed_at":"2026-09-09T10:39:20.191Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019002,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2398gitlab # [ 469.053693] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.195Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"90853e40b397be4741ed9612","created_at":"2026-09-09T10:39:12.205Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"288dea12e35e98477dfb70dde7fa1bbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:12.230Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-90853e40b397be4741ed9612: start","job_status":"start","queue_duration_s":7.964464,"scheduling_latency_s":7.964636}2399gitlab # [ 469.057539] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.292Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"90853e40b397be4741ed9612","created_at":"2026-09-09T10:39:12.205Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"288dea12e35e98477dfb70dde7fa1bbe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:12.230Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-90853e40b397be4741ed9612: done: 0.097821 sec","job_status":"done","queue_duration_s":7.964464,"scheduling_latency_s":7.964636,"redis_calls":15,"redis_duration_s":0.021815,"redis_read_bytes":144,"redis_write_bytes":4120,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":90,"redis_queues_calls":2,"redis_queues_duration_s":0.002001,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.0107,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.008609,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.097821,"completed_at":"2026-09-09T10:39:20.292Z","load_balancing_strategy":"primary","db_duration_s":0.002451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2400gitlab # [ 469.163317] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"93b18556541ed5f3ab4d5a1b","created_at":"2026-09-09T10:39:12.310Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"336f14d5a9e2acdfc1f0fee57d38ca8c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:12.326Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-93b18556541ed5f3ab4d5a1b: start","job_status":"start","queue_duration_s":7.973644,"scheduling_latency_s":7.973694}2401gitlab # [ 469.168355] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.380Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"93b18556541ed5f3ab4d5a1b","created_at":"2026-09-09T10:39:12.310Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-195fbd4bb11b4bcb","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"336f14d5a9e2acdfc1f0fee57d38ca8c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:12.326Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-93b18556541ed5f3ab4d5a1b: done: 0.079168 sec","job_status":"done","queue_duration_s":7.973644,"scheduling_latency_s":7.973694,"redis_calls":8,"redis_duration_s":0.008982,"redis_read_bytes":133,"redis_write_bytes":879,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00112,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":103,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006017,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001845,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079168,"completed_at":"2026-09-09T10:39:20.378Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2402gitlab # [ 469.255974] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.388Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c84b881dd6ce4d3825a6979d"],"class":"WebHooks::LogExecutionWorker","jid":"28b82089b8f8443735ee0789","created_at":"2026-09-09T10:39:14.826Z","trace_propagation_headers":{"sentry-trace":"11d6afd5899641918c5b6b73293077ed-d9690e7c42134c6b","baggage":"sentry-trace_id=11d6afd5899641918c5b6b73293077ed,sentry-release=Unknown"},"correlation_id":"01M22VZKAQ14VTF170BVKAY02W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dacddb5c40b40324068ef1e45ba33c3d7cb6141d1143a9af24759cdcb91a95f8","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:14.832Z","job_size_bytes":2591,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-28b82089b8f8443735ee0789: start","job_status":"start","queue_duration_s":5.556002,"scheduling_latency_s":5.556059}2403gitlab # [ 469.263206] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.495Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c84b881dd6ce4d3825a6979d"],"class":"WebHooks::LogExecutionWorker","jid":"28b82089b8f8443735ee0789","created_at":"2026-09-09T10:39:14.826Z","trace_propagation_headers":{"sentry-trace":"11d6afd5899641918c5b6b73293077ed-d9690e7c42134c6b","baggage":"sentry-trace_id=11d6afd5899641918c5b6b73293077ed,sentry-release=Unknown"},"correlation_id":"01M22VZKAQ14VTF170BVKAY02W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dacddb5c40b40324068ef1e45ba33c3d7cb6141d1143a9af24759cdcb91a95f8","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:14.832Z","job_size_bytes":2591,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-28b82089b8f8443735ee0789: done: 0.107521 sec","job_status":"done","queue_duration_s":5.556002,"scheduling_latency_s":5.556059,"redis_calls":7,"redis_duration_s":0.012963,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.027,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.027,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.107521,"completed_at":"2026-09-09T10:39:20.495Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2404gitlab # [ 469.334929] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.502Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"816a92f2f81e83d8e5ea5b02","created_at":"2026-09-09T10:39:15.032Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-c0a77a501c7548b7","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:15.051Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-816a92f2f81e83d8e5ea5b02: start","job_status":"start","queue_duration_s":5.450532,"scheduling_latency_s":5.45059}2405gitlab # [ 469.525204] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.778Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"816a92f2f81e83d8e5ea5b02","created_at":"2026-09-09T10:39:15.032Z","trace_propagation_headers":{"sentry-trace":"79c0049cd5da431cb4a0dfeea12f23de-c0a77a501c7548b7","baggage":"sentry-trace_id=79c0049cd5da431cb4a0dfeea12f23de,sentry-release=Unknown"},"correlation_id":"01M22VV2S8Z5SQJE5CX0NVH745","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:15.051Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-816a92f2f81e83d8e5ea5b02: done: 0.276274 sec","job_status":"done","queue_duration_s":5.450532,"scheduling_latency_s":5.45059,"redis_calls":11,"redis_duration_s":0.015196,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002697,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005575,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006924,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.023,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.152467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070428,"duration_s":0.276274,"completed_at":"2026-09-09T10:39:20.778Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2406gitlab # [ 469.609818] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.860Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"021c4fe7567164971c7dc125","created_at":"2026-09-09T10:39:16.995Z","trace_propagation_headers":{"sentry-trace":"54d085c9f82a4336993aeafb9f226e9b-5da50e508f7d4249","baggage":"sentry-trace_id=54d085c9f82a4336993aeafb9f226e9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22W08DADZW44CS2XXFGNENS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:17.005Z","job_size_bytes":65,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-021c4fe7567164971c7dc125: start","job_status":"start","queue_duration_s":3.855349,"scheduling_latency_s":3.855409}2407gitlab # [ 469.678232] gitaly[863]: time="2026-09-09T10:39:20.931Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0CN2637RNDAHXSFQZ4ZE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:50.829" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:20.930" grpc.time_ms=0.988 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2408gitlab # [ 469.704764] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:20.956Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"021c4fe7567164971c7dc125","created_at":"2026-09-09T10:39:16.995Z","trace_propagation_headers":{"sentry-trace":"54d085c9f82a4336993aeafb9f226e9b-5da50e508f7d4249","baggage":"sentry-trace_id=54d085c9f82a4336993aeafb9f226e9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22W08DADZW44CS2XXFGNENS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:17.005Z","job_size_bytes":65,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-021c4fe7567164971c7dc125: done: 0.095684 sec","job_status":"done","queue_duration_s":3.855349,"scheduling_latency_s":3.855409,"redis_calls":7,"redis_duration_s":0.009720000000000001,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008337,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001383,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.095684,"completed_at":"2026-09-09T10:39:20.956Z","load_balancing_strategy":"primary","db_duration_s":0.014792,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2409gitlab # [ 469.759755] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2732410gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses, in 1.10 seconds)2411gitlab # [ 469.760422] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:21.012Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d4a837ad3af27a76338680e5","created_at":"2026-09-09T10:39:17.007Z","trace_propagation_headers":{"sentry-trace":"54d085c9f82a4336993aeafb9f226e9b-5da50e508f7d4249","baggage":"sentry-trace_id=54d085c9f82a4336993aeafb9f226e9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22W08DADZW44CS2XXFGNENS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:17.019Z","job_size_bytes":65,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d4a837ad3af27a76338680e5: start","job_status":"start","queue_duration_s":3.99286,"scheduling_latency_s":3.992915}2412gitlab # [ 469.945835] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:21.198Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d4a837ad3af27a76338680e5","created_at":"2026-09-09T10:39:17.007Z","trace_propagation_headers":{"sentry-trace":"54d085c9f82a4336993aeafb9f226e9b-5da50e508f7d4249","baggage":"sentry-trace_id=54d085c9f82a4336993aeafb9f226e9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22W08DADZW44CS2XXFGNENS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:17.019Z","job_size_bytes":65,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d4a837ad3af27a76338680e5: done: 0.186294 sec","job_status":"done","queue_duration_s":3.99286,"scheduling_latency_s":3.992915,"redis_calls":10,"redis_duration_s":0.006332,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003302,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00303,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.186294,"completed_at":"2026-09-09T10:39:21.198Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040824,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2413gitlab # [ 470.007455] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:21.260Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a11348cc32e1222e5be4c586","created_at":"2026-09-09T10:39:17.149Z","trace_propagation_headers":{"sentry-trace":"54d085c9f82a4336993aeafb9f226e9b-5da50e508f7d4249","baggage":"sentry-trace_id=54d085c9f82a4336993aeafb9f226e9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22W08DADZW44CS2XXFGNENS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:17.158Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a11348cc32e1222e5be4c586: start","job_status":"start","queue_duration_s":4.10189,"scheduling_latency_s":4.101964}2414gitlab # [ 470.250169] gitaly[863]: time="2026-09-09T10:39:21.503Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:39:51.301" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:21.502" grpc.time_ms=1.406 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2415gitlab # [ 470.359497] gitaly[863]: time="2026-09-09T10:39:21.613Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W08DADZW44CS2XXFGNENS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:51.409" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:21.610" grpc.time_ms=1.252 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2416gitlab # [ 470.399547] nix-daemon[3220]: accepted connection from pid 4775, user nixbot2417gitlab # [ 470.402890] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:21.656Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a11348cc32e1222e5be4c586","created_at":"2026-09-09T10:39:17.149Z","trace_propagation_headers":{"sentry-trace":"54d085c9f82a4336993aeafb9f226e9b-5da50e508f7d4249","baggage":"sentry-trace_id=54d085c9f82a4336993aeafb9f226e9b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22W08DADZW44CS2XXFGNENS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:17.158Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a11348cc32e1222e5be4c586: done: 0.395662 sec","job_status":"done","queue_duration_s":4.10189,"scheduling_latency_s":4.101964,"gitaly_calls":2,"gitaly_duration_s":0.017197,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.029606,"redis_read_bytes":80,"redis_write_bytes":5120,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.004324,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00207,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000743,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1131,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005008,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000714,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.004996,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007427,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.068,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.02,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.042,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.217239,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.276499108,"duration_s":0.395662,"completed_at":"2026-09-09T10:39:21.655Z","load_balancing_strategy":"primary","db_duration_s":0.079991,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2418gitlab # [ 470.466289] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:21.661Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"61570f4dbc97687154c01168","created_at":"2026-09-09T10:39:18.496Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.504Z","job_size_bytes":23,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-61570f4dbc97687154c01168: start","job_status":"start","queue_duration_s":3.157695,"scheduling_latency_s":3.15775}2419gitlab # [ 470.491249] nix-daemon[3220]: accepted connection from pid 4724, user nixbot2420gitlab # [ 470.567260] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:21.818Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"61570f4dbc97687154c01168","created_at":"2026-09-09T10:39:18.496Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.504Z","job_size_bytes":23,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-61570f4dbc97687154c01168: done: 0.157077 sec","job_status":"done","queue_duration_s":3.157695,"scheduling_latency_s":3.15775,"redis_calls":7,"redis_duration_s":0.019759000000000002,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.016254,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003505,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.157077,"completed_at":"2026-09-09T10:39:21.818Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01637,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2421gitlab # [ 470.644788] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:21.895Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e0720efe25892779324e83e2","created_at":"2026-09-09T10:39:18.807Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.825Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e0720efe25892779324e83e2: start","job_status":"start","queue_duration_s":3.069924,"scheduling_latency_s":3.06999}2422gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses2423gitlab # [ 470.717746] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:21.970Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e0720efe25892779324e83e2","created_at":"2026-09-09T10:39:18.807Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.825Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e0720efe25892779324e83e2: done: 0.075272 sec","job_status":"done","queue_duration_s":3.069924,"scheduling_latency_s":3.06999,"redis_calls":7,"redis_duration_s":0.008109,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006965,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001144,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.075272,"completed_at":"2026-09-09T10:39:21.970Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009546,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2424gitlab # [ 470.812158] gitaly[863]: time="2026-09-09T10:39:22.065Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0DNGKGVM6TK56MHHFTD9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:52.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:22.063" grpc.time_ms=1.057 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2425gitlab # [ 470.842246] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.067Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fb4ce3595d925922d17a70ef","created_at":"2026-09-09T10:39:18.851Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.858Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fb4ce3595d925922d17a70ef: start","job_status":"start","queue_duration_s":3.208755,"scheduling_latency_s":3.208816}2426gitlab # [ 470.943739] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.196Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fb4ce3595d925922d17a70ef","created_at":"2026-09-09T10:39:18.851Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.858Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fb4ce3595d925922d17a70ef: done: 0.129923 sec","job_status":"done","queue_duration_s":3.208755,"scheduling_latency_s":3.208816,"redis_calls":7,"redis_duration_s":0.018293,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.014219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004074,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.129923,"completed_at":"2026-09-09T10:39:22.196Z","load_balancing_strategy":"primary","db_duration_s":0.019059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2427gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses, in 0.25 seconds)2428gitlab # [ 471.029746] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.207Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"afc48ad70189927072933e90","created_at":"2026-09-09T10:39:18.888Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.895Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-afc48ad70189927072933e90: start","job_status":"start","queue_duration_s":3.311942,"scheduling_latency_s":3.312011}2429gitlab # [ 471.060319] gitaly[863]: time="2026-09-09T10:39:22.213Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22W0DNGKGVM6TK56MHHFTD9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:32.142" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:22.192" grpc.time_ms=20.562 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2430gitlab # [ 471.062069] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1962431gitlab # [ 471.063729] gitaly[863]: time="2026-09-09T10:39:22.215Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0DZ9QMA74164V1N60K56 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:52.210" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:22.211" grpc.time_ms=3.635 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2432gitlab # [ 471.064940] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.315Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"afc48ad70189927072933e90","created_at":"2026-09-09T10:39:18.888Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.895Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-afc48ad70189927072933e90: done: 0.107951 sec","job_status":"done","queue_duration_s":3.311942,"scheduling_latency_s":3.312011,"redis_calls":10,"redis_duration_s":0.017001,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.004163,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009037,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.107951,"completed_at":"2026-09-09T10:39:22.315Z","load_balancing_strategy":"primary","db_duration_s":0.017316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2433gitlab # [ 471.152845] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.319Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"97ba4fd8d1a2b7c2657fabf4","created_at":"2026-09-09T10:39:18.901Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.910Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-97ba4fd8d1a2b7c2657fabf4: start","job_status":"start","queue_duration_s":3.409115,"scheduling_latency_s":3.40917}2434gitlab # [ 471.154121] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.385Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"97ba4fd8d1a2b7c2657fabf4","created_at":"2026-09-09T10:39:18.901Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.910Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-97ba4fd8d1a2b7c2657fabf4: done: 0.066187 sec","job_status":"done","queue_duration_s":3.409115,"scheduling_latency_s":3.40917,"redis_calls":7,"redis_duration_s":0.0034549999999999997,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002467,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.066187,"completed_at":"2026-09-09T10:39:22.385Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010383,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2435gitlab # [ 471.187657] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.388Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ca5b57de69ec713d852e573e","created_at":"2026-09-09T10:39:18.911Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.922Z","job_size_bytes":19,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ca5b57de69ec713d852e573e: start","job_status":"start","queue_duration_s":3.46612,"scheduling_latency_s":3.466184}2436gitlab # [ 471.249121] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.442Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ca5b57de69ec713d852e573e","created_at":"2026-09-09T10:39:18.911Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.922Z","job_size_bytes":19,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ca5b57de69ec713d852e573e: done: 0.05367 sec","job_status":"done","queue_duration_s":3.46612,"scheduling_latency_s":3.466184,"redis_calls":8,"redis_duration_s":0.003395,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002589,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000806,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05367,"completed_at":"2026-09-09T10:39:22.442Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2437gitlab # [ 471.274374] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.446Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5fd4da6c9f807805c822bdb7","created_at":"2026-09-09T10:39:18.925Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.932Z","job_size_bytes":66,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5fd4da6c9f807805c822bdb7: start","job_status":"start","queue_duration_s":3.514291,"scheduling_latency_s":3.514339}2438gitlab # [ 471.306162] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.549Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5fd4da6c9f807805c822bdb7","created_at":"2026-09-09T10:39:18.925Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.932Z","job_size_bytes":66,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5fd4da6c9f807805c822bdb7: done: 0.102799 sec","job_status":"done","queue_duration_s":3.514291,"scheduling_latency_s":3.514339,"redis_calls":7,"redis_duration_s":0.021429,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.019034,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002395,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.102799,"completed_at":"2026-09-09T10:39:22.549Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2439gitlab # [ 471.411652] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.555Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e1bc177c424e66ceb864cb1e","created_at":"2026-09-09T10:39:18.934Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.939Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e1bc177c424e66ceb864cb1e: start","job_status":"start","queue_duration_s":3.615491,"scheduling_latency_s":3.615544}2440gitlab # [ 471.541794] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.636Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e1bc177c424e66ceb864cb1e","created_at":"2026-09-09T10:39:18.934Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.939Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e1bc177c424e66ceb864cb1e: done: 0.081524 sec","job_status":"done","queue_duration_s":3.615491,"scheduling_latency_s":3.615544,"redis_calls":7,"redis_duration_s":0.006882,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002568,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.081524,"completed_at":"2026-09-09T10:39:22.636Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024474,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2441gitlab # [ 471.617960] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.641Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"01a8925d3beb79c5c202962e","created_at":"2026-09-09T10:39:18.940Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.944Z","job_size_bytes":6,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-01a8925d3beb79c5c202962e: start","job_status":"start","queue_duration_s":3.696898,"scheduling_latency_s":3.696948}2442gitlab # [ 471.619303] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.737Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"01a8925d3beb79c5c202962e","created_at":"2026-09-09T10:39:18.940Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.944Z","job_size_bytes":6,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-01a8925d3beb79c5c202962e: done: 0.095335 sec","job_status":"done","queue_duration_s":3.696898,"scheduling_latency_s":3.696948,"redis_calls":7,"redis_duration_s":0.015117,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003697,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.095335,"completed_at":"2026-09-09T10:39:22.737Z","load_balancing_strategy":"primary","db_duration_s":0.002878,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2443gitlab # [ 471.719686] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.749Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"59ea7ecfc58bd1b3d837900d","created_at":"2026-09-09T10:39:18.946Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.951Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-59ea7ecfc58bd1b3d837900d: start","job_status":"start","queue_duration_s":3.798164,"scheduling_latency_s":3.798226}2444gitlab # [ 471.728290] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"59ea7ecfc58bd1b3d837900d","created_at":"2026-09-09T10:39:18.946Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:18.951Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-59ea7ecfc58bd1b3d837900d: done: 0.093252 sec","job_status":"done","queue_duration_s":3.798164,"scheduling_latency_s":3.798226,"redis_calls":7,"redis_duration_s":0.013123,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007452,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.093252,"completed_at":"2026-09-09T10:39:22.842Z","load_balancing_strategy":"primary","db_duration_s":0.01262,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2445gitlab # [ 471.809506] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.847Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3b8792226f65f12b297e917c","created_at":"2026-09-09T10:39:19.099Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.135Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3b8792226f65f12b297e917c: start","job_status":"start","queue_duration_s":3.711352,"scheduling_latency_s":3.711406}2446gitlab # [ 471.811406] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.945Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3b8792226f65f12b297e917c","created_at":"2026-09-09T10:39:19.099Z","trace_propagation_headers":{"sentry-trace":"cd484422e4c043cda59930cb4cab9ced-1d34c043e21d4d8a","baggage":"sentry-trace_id=cd484422e4c043cda59930cb4cab9ced,sentry-release=Unknown"},"correlation_id":"01M22W034X8HJKDAFWFSW1J88E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.135Z","job_size_bytes":3,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3b8792226f65f12b297e917c: done: 0.098597 sec","job_status":"done","queue_duration_s":3.711352,"scheduling_latency_s":3.711406,"redis_calls":8,"redis_duration_s":0.015844,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010869,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004975,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.098597,"completed_at":"2026-09-09T10:39:22.945Z","load_balancing_strategy":"primary","db_duration_s":0.011865,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2447gitlab # [ 471.886251] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0010d64e0c83026284caf6a0","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0010d64e0c83026284caf6a0: start","job_status":"start","queue_duration_s":3.335549,"scheduling_latency_s":3.335598}2448gitlab # [ 471.888310] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0010d64e0c83026284caf6a0","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0010d64e0c83026284caf6a0: done: 0.044202 sec","job_status":"done","queue_duration_s":3.335549,"scheduling_latency_s":3.335598,"redis_calls":13,"redis_duration_s":0.009016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006408,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044202,"completed_at":"2026-09-09T10:39:22.993Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2449gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses2450gitlab # [ 471.987559] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:22.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b79e596865491d4e02873e9d","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b79e596865491d4e02873e9d: start","job_status":"start","queue_duration_s":3.383127,"scheduling_latency_s":3.383175}2451gitlab # [ 471.989630] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b79e596865491d4e02873e9d","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b79e596865491d4e02873e9d: done: 0.030977 sec","job_status":"done","queue_duration_s":3.383127,"scheduling_latency_s":3.383175,"redis_calls":13,"redis_duration_s":0.004565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002729,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030977,"completed_at":"2026-09-09T10:39:23.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2452gitlab # [ 472.095769] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c4b7c3c24ecce487aa08af4","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c4b7c3c24ecce487aa08af4: start","job_status":"start","queue_duration_s":3.418893,"scheduling_latency_s":3.418949}2453gitlab # [ 472.097634] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c4b7c3c24ecce487aa08af4","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c4b7c3c24ecce487aa08af4: done: 0.060972 sec","job_status":"done","queue_duration_s":3.418893,"scheduling_latency_s":3.418949,"redis_calls":13,"redis_duration_s":0.02867,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.022747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060972,"completed_at":"2026-09-09T10:39:23.093Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2454gitlab # [ 472.179557] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4bb0811ffa32bc969b84c58","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4bb0811ffa32bc969b84c58: start","job_status":"start","queue_duration_s":3.485529,"scheduling_latency_s":3.485575}2455gitlab # [ 472.180868] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4bb0811ffa32bc969b84c58","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4bb0811ffa32bc969b84c58: done: 0.037694 sec","job_status":"done","queue_duration_s":3.485529,"scheduling_latency_s":3.485575,"redis_calls":13,"redis_duration_s":0.011526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037694,"completed_at":"2026-09-09T10:39:23.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2456gitlab # [ 472.252902] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac9f476f1f530b00c30bd877","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac9f476f1f530b00c30bd877: start","job_status":"start","queue_duration_s":3.536403,"scheduling_latency_s":3.536463}2457gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses, in 0.31 seconds)2458gitlab # [ 472.254062] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac9f476f1f530b00c30bd877","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac9f476f1f530b00c30bd877: done: 0.057816 sec","job_status":"done","queue_duration_s":3.536403,"scheduling_latency_s":3.536463,"redis_calls":13,"redis_duration_s":0.01695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005974,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.057816,"completed_at":"2026-09-09T10:39:23.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2459gitlab # [ 472.373633] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e56e47a2631a14410cf6120c","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e56e47a2631a14410cf6120c: start","job_status":"start","queue_duration_s":3.597365,"scheduling_latency_s":3.597411}2460gitlab # [ 472.375924] gitaly[863]: time="2026-09-09T10:39:23.463Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0F67EA842G69W14YRN4T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:53.460" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:23.461" grpc.time_ms=1.793 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2461gitlab # [ 472.377604] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 2502462gitlab # [ 472.378922] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e56e47a2631a14410cf6120c","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e56e47a2631a14410cf6120c: done: 0.026806 sec","job_status":"done","queue_duration_s":3.597365,"scheduling_latency_s":3.597411,"redis_calls":13,"redis_duration_s":0.0038789999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001361,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002518,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026806,"completed_at":"2026-09-09T10:39:23.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2463gitlab # [ 472.477996] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"808413bba217f5997b6444e6","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-808413bba217f5997b6444e6: start","job_status":"start","queue_duration_s":3.627003,"scheduling_latency_s":3.627049}2464gitlab # [ 472.479107] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"808413bba217f5997b6444e6","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-808413bba217f5997b6444e6: done: 0.034664 sec","job_status":"done","queue_duration_s":3.627003,"scheduling_latency_s":3.627049,"redis_calls":13,"redis_duration_s":0.012253,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009285,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034664,"completed_at":"2026-09-09T10:39:23.275Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2465gitlab # [ 472.575054] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"217bef291438f1d7dd92d9b9","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-217bef291438f1d7dd92d9b9: start","job_status":"start","queue_duration_s":3.664498,"scheduling_latency_s":3.664544}2466gitlab # [ 472.586176] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 18892467gitlab # [ 472.587260] nixbot[3042]: {"ts": "2026-09-09T10:39:23.664Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31a0e91e37b3d59648d358ba62ce24822d73dead \"HTTP/1.1 201 Created\""}2468gitlab # [ 472.588430] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"217bef291438f1d7dd92d9b9","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-217bef291438f1d7dd92d9b9: done: 0.036374 sec","job_status":"done","queue_duration_s":3.664498,"scheduling_latency_s":3.664544,"redis_calls":13,"redis_duration_s":0.006220999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002185,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036374,"completed_at":"2026-09-09T10:39:23.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2469gitlab # [ 472.668775] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da99479479636d468dd77092","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da99479479636d468dd77092: start","job_status":"start","queue_duration_s":3.707794,"scheduling_latency_s":3.707867}2470gitlab # [ 472.670487] gitaly[863]: time="2026-09-09T10:39:23.799Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0FGRW31MZP5ZFB9237GY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:53.797" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:23.797" grpc.time_ms=0.992 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2471gitlab # [ 472.672767] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da99479479636d468dd77092","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da99479479636d468dd77092: done: 0.03438 sec","job_status":"done","queue_duration_s":3.707794,"scheduling_latency_s":3.707867,"redis_calls":13,"redis_duration_s":0.00856,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002789,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005771,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03438,"completed_at":"2026-09-09T10:39:23.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2472gitlab # [ 472.760904] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fee8809f24d4a499df24dc43","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fee8809f24d4a499df24dc43: start","job_status":"start","queue_duration_s":3.744352,"scheduling_latency_s":3.744395}2473gitlab # [ 472.841217] gitaly[863]: time="2026-09-09T10:39:23.898Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=12 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M22W0FGRW31MZP5ZFB9237GY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:33.261" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:23.872" grpc.time_ms=26.056 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2474gitlab # [ 472.842495] nixbot[3042]: {"ts": "2026-09-09T10:39:24.040Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31a0e91e37b3d59648d358ba62ce24822d73dead \"HTTP/1.1 201 Created\""}2475gitlab # [ 472.844209] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3662476gitlab # [ 472.847127] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fee8809f24d4a499df24dc43","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fee8809f24d4a499df24dc43: done: 0.039614 sec","job_status":"done","queue_duration_s":3.744352,"scheduling_latency_s":3.744395,"redis_calls":13,"redis_duration_s":0.014908,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001432,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.013476,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039614,"completed_at":"2026-09-09T10:39:23.397Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2477gitlab # [ 472.864389] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2568dcdf88a07210efdfd2f2","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2568dcdf88a07210efdfd2f2: start","job_status":"start","queue_duration_s":3.788506,"scheduling_latency_s":3.788549}2478gitlab # [ 472.931853] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2568dcdf88a07210efdfd2f2","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2568dcdf88a07210efdfd2f2: done: 0.021772 sec","job_status":"done","queue_duration_s":3.788506,"scheduling_latency_s":3.788549,"redis_calls":13,"redis_duration_s":0.004187,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001301,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021772,"completed_at":"2026-09-09T10:39:23.423Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2479gitlab # [ 473.010491] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af4892a769959a872d965b06","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af4892a769959a872d965b06: start","job_status":"start","queue_duration_s":3.812284,"scheduling_latency_s":3.81232}2480gitlab # [ 473.013209] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af4892a769959a872d965b06","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af4892a769959a872d965b06: done: 0.226491 sec","job_status":"done","queue_duration_s":3.812284,"scheduling_latency_s":3.81232,"redis_calls":13,"redis_duration_s":0.011279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005145,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.189923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.226491,"completed_at":"2026-09-09T10:39:23.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2481gitlab # [ 473.106401] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6705d85e6a46621225a934e5","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6705d85e6a46621225a934e5: start","job_status":"start","queue_duration_s":4.041977,"scheduling_latency_s":4.042024}2482gitlab # [ 473.111675] gitaly[863]: time="2026-09-09T10:39:24.198Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22W0FWWBKS30QG4DMEYC0MW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:39:54.195" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:39:24.197" grpc.time_ms=0.862 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2483gitlab # [ 473.113093] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6705d85e6a46621225a934e5","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6705d85e6a46621225a934e5: done: 0.049232 sec","job_status":"done","queue_duration_s":4.041977,"scheduling_latency_s":4.042024,"redis_calls":13,"redis_duration_s":0.014125,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003155,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.01097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.049232,"completed_at":"2026-09-09T10:39:23.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2484gitlab # [ 473.201155] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab4eef5328706745ff02b864","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab4eef5328706745ff02b864: start","job_status":"start","queue_duration_s":4.093814,"scheduling_latency_s":4.093881}2485gitlab # [ 473.202438] gitaly[863]: time="2026-09-09T10:39:24.304Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22W0FWWBKS30QG4DMEYC0MW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:39:34.241" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:39:24.292" grpc.time_ms=11.799 pid=863 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2486gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses2487gitlab # [ 473.291379] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab4eef5328706745ff02b864","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab4eef5328706745ff02b864: done: 0.05898 sec","job_status":"done","queue_duration_s":4.093814,"scheduling_latency_s":4.093881,"redis_calls":13,"redis_duration_s":0.024137,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.022208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.05898,"completed_at":"2026-09-09T10:39:23.766Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2488gitlab # [ 473.294054] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f16b1f8ce0e1d8f848176855","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f16b1f8ce0e1d8f848176855: start","job_status":"start","queue_duration_s":4.159771,"scheduling_latency_s":4.159826}2489gitlab # [ 473.389871] nixbot[3042]: {"ts": "2026-09-09T10:39:24.483Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31a0e91e37b3d59648d358ba62ce24822d73dead \"HTTP/1.1 201 Created\""}2490gitlab # [ 473.399430] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/09:10:39:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31a0e91e37b3d59648d358ba62ce24822d73dead HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 4202491gitlab # [ 473.403529] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f16b1f8ce0e1d8f848176855","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f16b1f8ce0e1d8f848176855: done: 0.042684 sec","job_status":"done","queue_duration_s":4.159771,"scheduling_latency_s":4.159826,"redis_calls":13,"redis_duration_s":0.009599,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005198,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004401,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042684,"completed_at":"2026-09-09T10:39:23.816Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2492gitlab # [ 473.416306] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1975bdfaa972ed9b4a11789","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1975bdfaa972ed9b4a11789: start","job_status":"start","queue_duration_s":4.206432,"scheduling_latency_s":4.206482}2493gitlab # [ 473.500836] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1975bdfaa972ed9b4a11789","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1975bdfaa972ed9b4a11789: done: 0.058438 sec","job_status":"done","queue_duration_s":4.206432,"scheduling_latency_s":4.206482,"redis_calls":13,"redis_duration_s":0.008685,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005717,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.058438,"completed_at":"2026-09-09T10:39:23.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2494gitlab # [ 473.522849] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e502ed9ae7a37e0d0ff55f0d","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e502ed9ae7a37e0d0ff55f0d: start","job_status":"start","queue_duration_s":4.268549,"scheduling_latency_s":4.268594}2495gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31a0e91e37b3d59648d358ba62ce24822d73dead/statuses, in 0.31 seconds)2496(finished: subtest: eval and build post commit statuses, in 7.53 seconds)2497(finished: run the VM test script, in 577.19 seconds)2498gitlab # [ 473.535968] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e502ed9ae7a37e0d0ff55f0d","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e502ed9ae7a37e0d0ff55f0d: done: 0.032797 sec","job_status":"done","queue_duration_s":4.268549,"scheduling_latency_s":4.268594,"redis_calls":13,"redis_duration_s":0.005156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001338,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003818,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032797,"completed_at":"2026-09-09T10:39:23.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2499gitlab # [ 473.603055] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c63b9777313cf27cd2b1e84","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c63b9777313cf27cd2b1e84: start","job_status":"start","queue_duration_s":4.307799,"scheduling_latency_s":4.307867}2500test script finished in 577.27s2501cleanup2502kill QemuMachine (pid 46)2503gitlab # [ 473.620561] sidekiq-cluster[2922]: {"severity":"INFO","time":"2026-09-09T10:39:23.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c63b9777313cf27cd2b1e84","created_at":"2026-09-09T10:39:19.495Z","trace_propagation_headers":{"sentry-trace":"d976b677ba8a48e288d6ea584fa881ee-4711859aab7f4ad1","baggage":"sentry-trace_id=d976b677ba8a48e288d6ea584fa881ee,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f68024ff8f85815239ff33214e1656fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:39:19.613Z","job_size_bytes":2,"pid":2922,"sidekiq_tid":"m87q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c63b9777313cf27cd2b1e84: done: 0.035042 sec","job_status":"done","queue_duration_s":4.307799,"scheduling_latency_s":4.307867,"redis_calls":13,"redis_duration_s":0.00349,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001172,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002318,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2504gitlab # .2505(finished: cleanup, in 3.97 seconds)2506additionally exposed symbols:2507 gitlab,2508 vlan1,2509 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2510[]2511[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-09T10:36:32.060Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2512[]2513[]2514[]2515[]2516[]2517[]2518[]2519[]2520[]2521[]2522[]2523[]2524[]2525[]2526[]2527[]2528[]2529[]2530[]2531[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '31a0e91e37b3d59648d358ba62ce24822d73dead', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-09T10:39:16.385023Z', 'started_at': '2026-09-09T10:39:17.218692Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2532[{'id': 5, 'sha': '31a0e91e37b3d59648d358ba62ce24822d73dead', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:39:17.130Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2533[{'id': 5, 'sha': '31a0e91e37b3d59648d358ba62ce24822d73dead', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:39:17.130Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2534[{'id': 5, 'sha': '31a0e91e37b3d59648d358ba62ce24822d73dead', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:39:17.130Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2535[{'id': 5, 'sha': '31a0e91e37b3d59648d358ba62ce24822d73dead', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:39:17.130Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2536[{'id': 5, 'sha': '31a0e91e37b3d59648d358ba62ce24822d73dead', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-09-09T10:39:17.130Z', 'started_at': None, 'finished_at': '2026-09-09T10:39:22.285Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2537[{'id': 5, 'sha': '31a0e91e37b3d59648d358ba62ce24822d73dead', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-09-09T10:39:17.130Z', 'started_at': None, 'finished_at': '2026-09-09T10:39:22.285Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '31a0e91e37b3d59648d358ba62ce24822d73dead', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-09T10:39:23.982Z', 'started_at': None, 'finished_at': '2026-09-09T10:39:24.392Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]