nixbot

builds

succeeded vm-test-run-nixbot-gitlab checks.x86_64-linux.nixbot-gitlab · build #300 · raw

1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.GPfXIKCRIr', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 68.06 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 76462b44-105f-4cee-869f-da0f763b59ed19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c4ccy8ja53h0j3yl3y885wy9snn6s4iw-nixos-system-gitlab-test/init regInfo=/nix/store/6vib39cl86yivrm2sy0gb7dicv6a7kj9-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 465399465 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.010 MHz processor67gitlab # [ 0.000810] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000878] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002731] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002742] Using GB pages for direct mapping73gitlab # [ 0.002887] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002895] ACPI: Early table checksum verification disabled75gitlab # [ 0.002898] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002902] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002906] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002913] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002915] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002917] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002918] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002920] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002921] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002922] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002923] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002923] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002924] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002924] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003146] No NUMA configuration found90gitlab # [ 0.003147] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003149] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005539] Zone ranges:93gitlab # [ 0.005539] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005541] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005542] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005543] Device empty97gitlab # [ 0.005544] Movable zone start for each node98gitlab # [ 0.005545] Early memory node ranges99gitlab # [ 0.005545] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005546] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005547] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005548] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005569] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005841] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.111842] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.112288] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.112303] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.112340] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.112343] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.112345] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.112346] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.112347] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.112348] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.112351] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.112352] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.112357] TSC deadline timer available117gitlab # [ 0.112361] CPU topo: Max. logical packages: 1118gitlab # [ 0.112362] CPU topo: Max. logical dies: 1119gitlab # [ 0.112362] CPU topo: Max. dies per package: 1120gitlab # [ 0.112365] CPU topo: Max. threads per core: 1121gitlab # [ 0.112366] CPU topo: Num. cores per package: 4122gitlab # [ 0.112367] CPU topo: Num. threads per package: 4123gitlab # [ 0.112367] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.112392] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.112410] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.112412] kvm-guest: setup PV sched yield127gitlab # [ 0.112429] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.112430] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.112432] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.112433] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.112435] Booting paravirtualized kernel on KVM132gitlab # [ 0.112439] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.116879] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.119166] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.119224] kvm-guest: PV spinlocks enabled136gitlab # [ 0.119225] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.119228] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c4ccy8ja53h0j3yl3y885wy9snn6s4iw-nixos-system-gitlab-test/init regInfo=/nix/store/6vib39cl86yivrm2sy0gb7dicv6a7kj9-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.119328] Unknown kernel command line parameters "regInfo=/nix/store/6vib39cl86yivrm2sy0gb7dicv6a7kj9-closure-info/registration", will be passed to user space.139gitlab # [ 0.119341] random: crng init done140gitlab # [ 0.119342] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.127776] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.131936] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.132008] software IO TLB: area num 4.144gitlab # [ 0.203408] Fallback order for Node 0: 0145gitlab # [ 0.203417] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.203419] Policy zone: Normal147gitlab # [ 0.205970] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.215969] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.228648] allocated 12582912 bytes of page_ext150gitlab # [ 0.238574] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.238577] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.239449] Dynamic Preempt: lazy153gitlab # [ 0.239623] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.239624] rcu: RCU event tracing is enabled.155gitlab # [ 0.239624] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.239626] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.239627] Rude variant of Tasks RCU enabled.158gitlab # [ 0.239627] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.239628] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.239629] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.239662] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.239665] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.239666] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.244018] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.244504] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.244514] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.244626] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.248239] Console: colour VGA+ 80x25169gitlab # [ 0.248242] printk: legacy console [tty0] enabled170gitlab # [ 0.278609] printk: legacy console [ttyS0] enabled171gitlab # [ 0.386358] ACPI: Core revision 20250807172gitlab # [ 0.387267] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.388879] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.389930] x2apic enabled175gitlab # [ 0.390682] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.391654] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.392951] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.394458] kvm-guest: setup PV IPIs179gitlab # [ 0.396037] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.397087] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns181gitlab # [ 0.398874] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010)182gitlab # [ 0.399958] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.401001] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.402871] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.403875] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.404871] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.405871] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.407661] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.408628] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.409681] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.410880] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.411872] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.412871] active return thunk: srso_alias_return_thunk194gitlab # [ 0.413892] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.414870] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.416715] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.417870] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.418870] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.419870] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.420870] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.421871] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.423671] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.424676] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.425870] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.426869] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.427870] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.457784] Freeing SMP alternatives memory: 44K208gitlab # [ 0.458480] pid_max: default: 32768 minimum: 301209gitlab # [ 0.458978] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.459975] landlock: Up and running.211gitlab # [ 0.461361] Yama: becoming mindful.212gitlab # [ 0.462091] LSM support for eBPF active213gitlab # [ 0.463092] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.464012] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.467156] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.468485] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.468880] ... version: 2218gitlab # [ 0.469699] ... bit width: 48219gitlab # [ 0.470473] ... generic counters: 6220gitlab # [ 0.470873] ... generic bitmap: 000000000000003f221gitlab # [ 0.471826] ... fixed-purpose counters: 0222gitlab # [ 0.472433] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.472873] ... value mask: 0000ffffffffffff224gitlab # [ 0.473830] ... max period: 00007fffffffffff225gitlab # [ 0.474628] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.474975] signal: max sigframe size: 3376227gitlab # [ 0.475831] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.476538] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.477056] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.482494] smp: Bringing up secondary CPUs ...231gitlab # [ 0.483255] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.483881] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.487018] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.488593] smpboot: Total of 4 processors activated (19200.08 BogoMIPS)235gitlab # [ 0.489200] Memory: 6011536K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.490873] devtmpfs: initialized237gitlab # [ 0.491717] x86/mm: Memory block size: 128MB238gitlab # [ 0.494937] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.495945] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.496975] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.498183] PM: RTC time: 10:13:00, date: 2026-09-03242gitlab # [ 0.501632] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.503456] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.503939] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.505919] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.506883] audit: initializing netlink subsys (disabled)247gitlab # [ 0.507922] audit: type=2000 audit(1788430381.402:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.508277] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.509874] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.510873] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.511873] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.512873] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.513886] cpuidle: using governor menu254gitlab # [ 0.516098] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.517113] PCI: Using configuration type 1 for base access256gitlab # [ 0.517875] PCI: Using configuration type 1 for extended access257gitlab # [ 0.519069] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.521227] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.523880] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.526883] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.529879] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.536309] ACPI: Added _OSI(Module Device)263gitlab # [ 0.536876] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.537718] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.540565] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.544390] ACPI: Interpreter enabled267gitlab # [ 0.545971] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.547882] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.549988] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.553882] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.556322] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.570133] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.572893] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.576953] acpiphp: Slot [3] registered275gitlab # [ 0.578934] acpiphp: Slot [4] registered276gitlab # [ 0.580948] acpiphp: Slot [5] registered277gitlab # [ 0.581932] acpiphp: Slot [6] registered278gitlab # [ 0.583920] acpiphp: Slot [7] registered279gitlab # [ 0.584934] acpiphp: Slot [8] registered280gitlab # [ 0.586917] acpiphp: Slot [9] registered281gitlab # [ 0.587916] acpiphp: Slot [10] registered282gitlab # [ 0.589915] acpiphp: Slot [11] registered283gitlab # [ 0.590934] acpiphp: Slot [12] registered284gitlab # [ 0.591918] acpiphp: Slot [13] registered285gitlab # [ 0.593915] acpiphp: Slot [14] registered286gitlab # [ 0.594915] acpiphp: Slot [15] registered287gitlab # [ 0.595931] acpiphp: Slot [16] registered288gitlab # [ 0.597917] acpiphp: Slot [17] registered289gitlab # [ 0.598916] acpiphp: Slot [18] registered290gitlab # [ 0.600914] acpiphp: Slot [19] registered291gitlab # [ 0.601797] acpiphp: Slot [20] registered292gitlab # [ 0.602427] acpiphp: Slot [21] registered293gitlab # [ 0.602894] acpiphp: Slot [22] registered294gitlab # [ 0.603661] acpiphp: Slot [23] registered295gitlab # [ 0.603893] acpiphp: Slot [24] registered296gitlab # [ 0.604613] acpiphp: Slot [25] registered297gitlab # [ 0.605900] acpiphp: Slot [26] registered298gitlab # [ 0.606660] acpiphp: Slot [27] registered299gitlab # [ 0.606893] acpiphp: Slot [28] registered300gitlab # [ 0.607646] acpiphp: Slot [29] registered301gitlab # [ 0.608894] acpiphp: Slot [30] registered302gitlab # [ 0.610131] acpiphp: Slot [31] registered303gitlab # [ 0.610775] PCI host bridge to bus 0000:00304gitlab # [ 0.611418] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.612875] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.613873] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.614874] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.616873] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.617886] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.619191] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.621487] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.623306] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.626505] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.626901] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.627874] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.628873] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.629873] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.632068] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.633931] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.636005] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.638172] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.639880] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.641119] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.652939] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.653889] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.654921] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.656058] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.658643] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.662908] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.664581] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.665896] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.678920] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.681809] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.692921] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.695894] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.697934] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.704957] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.714921] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.716889] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.718919] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.724370] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.731164] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.732888] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.734919] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.738181] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.746239] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.748896] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.750933] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.758732] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.770919] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.772895] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.775935] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.782139] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.792909] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.794894] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.796921] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.799892] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.804337] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.809689] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.810713] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.813293] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.817918] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.819882] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.820924] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.826321] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.831909] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.833889] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.835919] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.843090] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.845030] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.846012] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.847006] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.847954] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.851069] iommu: Default domain type: Translated375gitlab # [ 0.851876] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.853176] ACPI: bus type USB registered377gitlab # [ 0.853953] usbcore: registered new interface driver usbfs378gitlab # [ 0.854889] usbcore: registered new interface driver hub379gitlab # [ 0.855836] usbcore: registered new device driver usb380gitlab # [ 0.858922] NetLabel: Initializing381gitlab # [ 0.859602] NetLabel: domain hash size = 128382gitlab # [ 0.859874] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.860874] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.861847] PCI: Using ACPI for IRQ routing385gitlab # [ 0.863050] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.863869] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.863869] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.866876] vgaarb: loaded389gitlab # [ 0.867627] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.867874] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.875874] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.877707] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.878936] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.882728] pnp: PnP ACPI init395gitlab # [ 0.885794] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.900063] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.903695] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.906200] NET: Registered PF_INET protocol family399gitlab # [ 0.911188] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.935451] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.937003] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.938397] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.942190] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.943599] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.945047] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.946673] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.948158] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.949658] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.950658] NET: Registered PF_XDP protocol family410gitlab # [ 0.951575] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.952616] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.953656] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.954821] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.955995] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.957400] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.958432] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.960904] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.963442] PCI: CLS 0 bytes, default 64419gitlab # [ 0.964282] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.964862] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.965452] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.965581] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns423gitlab # [ 0.989183] Initialise system trusted keyrings424gitlab # [ 0.990339] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.001855] Key type asymmetric registered426gitlab # [ 1.002601] Asymmetric key parser 'x509' registered427gitlab # [ 1.003533] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.005207] io scheduler mq-deadline registered429gitlab # [ 1.006040] io scheduler kyber registered430gitlab # [ 1.009986] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.011317] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.013835] Linux agpgart interface v0.103433gitlab # [ 1.014648] ACPI: bus type drm_connector registered434gitlab # [ 1.017078] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.018208] usbserial: USB Serial support registered for generic436gitlab # [ 1.019241] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.019241] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.021602] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.023044] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.024297] NET: Registered PF_INET6 protocol family441gitlab # [ 1.026121] Segment Routing with IPv6442gitlab # [ 1.026845] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.028947] IPI shorthand broadcast: enabled444gitlab # [ 1.033596] sched_clock: Marking stable (888011162, 145355677)->(1056516588, -23149749)445gitlab # [ 1.035436] registered taskstats version 1446gitlab # [ 1.036484] Loading compiled-in X.509 certificates447gitlab # [ 1.046434] Demotion targets for Node 0: null448gitlab # [ 1.047580] Key type .fscrypt registered449gitlab # [ 1.048300] Key type fscrypt-provisioning registered450gitlab # [ 1.049323] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.050298] ima: Allocated hash algorithm: sha1452gitlab # [ 1.051220] ima: No architecture policies found453gitlab # [ 1.052297] PM: Magic number: 10:470:223454gitlab # [ 1.053999] RAS: Correctable Errors collector initialized.455gitlab # [ 1.058480] clk: Disabling unused clocks456gitlab # [ 1.059220] PM: genpd: Disabling unused power domains457gitlab # [ 1.245829] Freeing initrd memory: 29392K458gitlab # [ 1.253234] Freeing unused decrypted memory: 2028K459gitlab # [ 1.259575] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.262247] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.267163] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.271036] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.338939] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.340110] Run /init as init process465gitlab # [ 1.352880] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.378592] fuse: init (API version 7.45)467gitlab # [ 1.387016] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.394569] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.398069] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.440484] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.776557] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.814033] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.816332] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.818507] systemd[1]: Running in initrd.475gitlab # [ 1.821006] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.824110] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.936802] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.982913] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.991060] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.992276] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.993743] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.994981] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.996168] systemd[1]: Reached target Path Units.484gitlab # [ 1.997118] systemd[1]: Reached target Slice Units.485gitlab # [ 1.998027] systemd[1]: Reached target Swaps.486gitlab # [ 1.998865] systemd[1]: Reached target Timer Units.487gitlab # [ 1.999894] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.001157] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.002388] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.003433] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.004490] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.005479] systemd[1]: Reached target Socket Units.493gitlab # [ 2.007515] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.009631] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.011739] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.016441] systemd[1]: Starting Journal Service...497gitlab # [ 2.018731] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.019718] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.025455] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.027581] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.033542] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...502gitlab # [ 2.044416] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 2.047641] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 2.050144] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 2.051533] systemd-journald[91]: Collecting audit messages is disabled.506gitlab # [ 2.073061] netfs: FS-Cache loaded507gitlab # [ 2.078093] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.508gitlab # [ 2.081829] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.509gitlab # [ 2.084161] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev510gitlab # [ 2.086449] systemd[1]: Starting Create Static Device Nodes in /dev...511gitlab # [ 2.089951] 9pnet: Installing 9P2000 support512gitlab # [ 2.098817] systemd[1]: Finished Load Kernel Modules.513gitlab # [ 2.100223] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.514gitlab # [ 2.101932] systemd[1]: Finished Load Kernel Module 9pnet_virtio.515gitlab # [ 2.104517] systemd[1]: Starting Apply Kernel Variables...516gitlab # [ 2.106113] systemd[1]: Finished Create Static Device Nodes in /dev.517gitlab # [ 2.107548] systemd[1]: Reached target Preparation for Local File Systems.518gitlab # [ 2.108852] systemd[1]: Reached target Local File Systems.519gitlab # [ 1.972447] systemd-modules-load[93]: Using 4 probe threads520gitlab # [ 2.118566] systemd[1]: Starting Rule-based Manager for Device Events and Files...521gitlab # [ 1.974091] systemd-modules-load[93]: Inserted module 'virtio_balloon'522gitlab # [ 2.120217] systemd[1]: Started Journal Service.523gitlab # [ 1.975961] systemd-modules-load[93]: Inserted module 'virtio_gpu'524gitlab # [ 1.977393] systemd-modules-load[93]: Inserted module 'dm_mod'525gitlab # [ 1.985590] systemd[1]: Finished Apply Kernel Variables.526gitlab # [ 1.993218] systemd[1]: Starting Create System Files and Directories...527gitlab # [ 2.000587] systemd-udevd[104]: Using default interface naming scheme 'v261'.528gitlab # [ 2.010228] systemd[1]: Finished Create System Files and Directories.529gitlab # [ 2.011609] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.017382] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.018590] systemd[1]: Reached target System Initialization.532gitlab # [ 2.019516] systemd[1]: Reached target Basic System.533gitlab # [ 2.267310] SCSI subsystem initialized534gitlab # [ 2.286632] virtio_blk virtio4: 4/0/0 default/read/poll queues535gitlab # [ 2.292484] uhci_hcd 0000:00:01.2: UHCI Host Controller536gitlab # [ 2.295232] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)537gitlab # [ 2.297423] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1538gitlab # [ 2.299770] uhci_hcd 0000:00:01.2: detected 2 ports539gitlab # [ 2.303833] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140540gitlab # [ 2.304935] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18541gitlab # [ 2.306310] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1542gitlab # [ 2.306509] virtio_blk virtio5: 4/0/0 default/read/poll queues543gitlab # [ 2.306652] usb usb1: Product: UHCI Host Controller544gitlab # [ 2.309453] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd545gitlab # [ 2.310394] usb usb1: SerialNumber: 0000:00:01.2546gitlab # [ 2.311417] hub 1-0:1.0: USB hub found547gitlab # [ 2.311465] virtio_blk virtio5: [vdb] 11841800 512-byte logical blocks (6.06 GB/5.65 GiB)548gitlab # [ 2.311606] hub 1-0:1.0: 2 ports detected549gitlab # [ 2.320722] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12550gitlab # [ 2.325253] serio: i8042 KBD port at 0x60,0x64 irq 1551gitlab # [ 2.326175] serio: i8042 AUX port at 0x60,0x64 irq 12552gitlab # [ 2.329805] scsi host0: ata_piix553gitlab # [ 2.330924] scsi host1: ata_piix554gitlab # [ 2.331573] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0555gitlab # [ 2.332887] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556gitlab # [ 2.207079] (udev-worker)[123]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.211651] (udev-worker)[126]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.558gitlab # [ 2.214720] (udev-worker)[126]: Network interface NamePolicy= disabled on kernel command line.559gitlab # [ 2.224664] systemd[1]: Found device /dev/disk/by-label/nixos.560gitlab # [ 2.226320] systemd[1]: Reached target Initrd Root Device.561gitlab # [ 2.227377] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...562gitlab # [ 2.231497] systemd[1]: Found device /dev/disk/by-label/nix-store.563gitlab # [ 2.234831] systemd[1]: Starting Virtual Console Setup...564gitlab # [ 2.249077] systemd-fsck[156]: nixos: clean, 12/65536 files, 13019/262144 blocks565gitlab # [ 2.252534] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.566gitlab # [ 2.262905] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones.567gitlab # [ 2.264848] systemd[1]: Finished Virtual Console Setup.568gitlab # [ 2.493734] ata2: found unknown device (class 0)569gitlab # [ 2.497114] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100570gitlab # [ 2.501702] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5571gitlab # [ 2.528145] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0572gitlab # [ 2.541454] usb 1-1: new full-speed USB device number 2 using uhci_hcd573gitlab # [ 2.572021] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.599155] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.709012] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.712107] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.714863] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.716604] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.718180] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.752088] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.766558] usbcore: registered new interface driver usbhid582gitlab # [ 2.768643] usbhid: USB HID core driver583gitlab # [ 2.778542] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.782772] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.885764] systemd[1]: Mounting /sysroot...586gitlab # [ 3.357257] EXT4-fs (vda): mounted filesystem 76462b44-105f-4cee-869f-da0f763b59ed r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.219753] systemd[1]: Mounted /sysroot.588gitlab # [ 3.221990] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.227751] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.231436] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.242904] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.248322] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.255507] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.261316] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.267422] systemd[1]: Mounted /sysroot/nix/.rw-store.596gitlab # [ 3.421615] erofs (device vdb): mounted with root inode @ nid 128.597gitlab # [ 3.424876] 9p: Installing v9fs 9p2000 file system support598gitlab # [ 3.280218] systemd[1]: Starting rw-sysroot-nix-store.service...599gitlab # [ 3.288401] systemd[1]: Mounted /sysroot/nix/.ro-store.600gitlab # [ 3.290165] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.601gitlab # [ 3.292760] systemd[1]: Mounted /sysroot/run.602gitlab # [ 3.293938] systemd[1]: Mounted /sysroot/tmp/shared.603gitlab # [ 3.295212] systemd[1]: Mounted /sysroot/tmp/xchg.604gitlab # [ 3.296453] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.605gitlab # [ 3.298237] systemd[1]: Finished rw-sysroot-nix-store.service.606gitlab # [ 3.301357] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...607gitlab # [ 3.304055] systemd[1]: Reloading...608gitlab # [ 3.360938] systemd[1]: Reloading finished in 58 ms.609gitlab # [ 3.383470] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...610gitlab # [ 3.386382] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...611gitlab # [ 3.388894] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.391433] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.393731] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.395904] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.423308] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.425788] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.885861] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.939956] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.942248] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.944540] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.946440] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.980855] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.984240] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 3.999580] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.001546] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.003640] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.037551] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.039718] systemd[1]: Stopped target Basic System.629gitlab # [ 4.041578] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.043579] systemd[1]: Stopped target Path Units.631gitlab # [ 4.045425] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.048065] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.053325] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.055420] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.057712] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.060244] systemd[1]: Stopped target Swaps.637gitlab # [ 4.062274] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.064337] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.067603] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.069944] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.072891] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.074912] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.079074] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.081108] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.083080] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.084621] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.086629] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.088185] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.090377] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.092333] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.094215] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.095860] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.097308] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.099088] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.100889] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.102224] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.103579] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.104757] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.105634] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.106661] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.107736] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.108920] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.109853] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.110838] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.111870] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.112838] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.113555] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.114266] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.115336] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.116183] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.117269] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.118279] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.119279] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.126171] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.127227] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.128174] systemd[1]: Reached target Switch Root.677gitlab # [ 4.130201] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.261558] initrd-nixos-activation-start[226]: booting system configuration /nix/store/c4ccy8ja53h0j3yl3y885wy9snn6s4iw-nixos-system-gitlab-test679gitlab # [ 4.306280] initrd-nixos-activation-start[226]: running activation script...680gitlab # [ 4.550819] initrd-nixos-activation-start[249]: setting up /etc...681gitlab # [ 4.667985] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.670372] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.671853] systemd[1]: Starting Switch Root...684gitlab # [ 4.717848] systemd[1]: Switching root.685gitlab # [ 4.926883] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 5.038095] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.403152] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.409003] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.410934] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.412959] systemd[1]: Detected first boot.691gitlab # [ 5.415661] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.556952] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.656341] systemd[1]: Applying preset policy.694gitlab # [ 5.835857] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.953447] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.954802] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.956902] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.959155] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.960542] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.962033] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.962988] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.964269] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.965471] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.966256] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.967047] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.967942] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.968774] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.969624] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.970542] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.971515] systemd[1]: Reached target Path Units.711gitlab # [ 5.972232] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.973078] systemd[1]: Reached target Slice Units.713gitlab # [ 5.973865] systemd[1]: Reached target Swaps.714gitlab # [ 5.975285] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.977271] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.978680] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.980379] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.981367] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.983743] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.985017] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.986691] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.987859] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.989021] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.990383] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.993137] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.994270] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.995204] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.998291] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 6.000395] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 6.002415] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 6.006427] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 6.017074] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 6.020195] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 6.029563] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 6.031792] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 6.063269] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 6.066516] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 6.072961] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 6.074920] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 6.088622] systemd[1]: Starting Journal Service...741gitlab # [ 6.090630] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 6.094436] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 6.100305] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 6.101420] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 6.104289] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 6.112802] systemd[1]: Listening on Journal Log Access Socket.747gitlab # [ 6.113920] systemd[1]: Mounted Huge Pages File System.748gitlab # [ 6.115022] systemd[1]: Mounted POSIX Message Queue File System.749gitlab # [ 6.116308] systemd[1]: Mounted Kernel Debug File System.750gitlab # [ 6.117305] systemd[1]: Mounted Kernel Trace File System.751gitlab # [ 6.118908] systemd[1]: Finished Create List of Static Device Nodes.752gitlab # [ 6.120295] systemd[1]: modprobe@configfs.service: Deactivated successfully.753gitlab # [ 6.121795] systemd[1]: Finished Load Kernel Module configfs.754gitlab # [ 6.122994] systemd[1]: Mounted FUSE Control File System.755gitlab # [ 6.126959] systemd[1]: Mounting Kernel Configuration File System...756gitlab # [ 6.136591] systemd-journald[321]: Collecting audit messages is enabled.757gitlab # [ 6.141558] EXT4-fs (vda): re-mounted 76462b44-105f-4cee-869f-da0f763b59ed.758gitlab # [ 6.145090] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...759gitlab # [ 6.150764] loop: module loaded760gitlab # [ 6.153516] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.761gitlab # [ 6.010436] systemd[1]: Queued start job for default target Multi-User System.762gitlab # [ 6.155724] systemd[1]: Finished Load Kernel Modules.763gitlab # [ 6.011841] systemd[1]: Unnecessary job was removed for /dev/vdb.764gitlab # [ 6.013246] systemd[1]: systemd-journald.service: Deactivated successfully.765gitlab # [ 6.158484] systemd[1]: Started Journal Service.766gitlab # [ 6.014551] systemd-modules-load[322]: Using 3 probe threads767gitlab # [ 6.015814] systemd-modules-load[322]: Inserted module 'tls'768gitlab # [ 6.017066] systemd-oomd[323]: No swap; memory pressure usage will be degraded769gitlab # [ 6.018569] systemd-modules-load[322]: Inserted module 'loop'770gitlab # [ 6.019649] systemd[1]: Finished Remount Root and Kernel File Systems.771gitlab # [ 6.020764] systemd[1]: Mounted Kernel Configuration File System.772gitlab # [ 6.029670] systemd[1]: Listening on Disk Image Download Service Socket.773gitlab # [ 6.031923] systemd[1]: Starting Firewall...774gitlab # [ 6.033636] systemd[1]: Starting Flush Journal to Persistent Storage...775gitlab # [ 6.034937] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore776gitlab # [ 6.041915] systemd[1]: Starting Load/Save OS Random Seed...777gitlab # [ 6.044072] systemd[1]: Starting Apply Kernel Variables...778gitlab # [ 6.045191] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os779gitlab # [ 6.192749] systemd-journald[321]: Received client request to flush runtime journal.780gitlab # [ 6.092889] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.781gitlab # [ 6.094796] systemd[1]: Starting Create Static Device Nodes in /dev...782gitlab # [ 6.096392] systemd[1]: Finished Load/Save OS Random Seed.783gitlab # [ 6.097774] systemd[1]: Reached target First Boot Complete.784gitlab # [ 6.098772] systemd[1]: Finished Apply Kernel Variables.785gitlab # [ 6.099747] systemd[1]: Finished Create Static Device Nodes in /dev.786gitlab # [ 6.100674] systemd[1]: Reached target Preparation for Local File Systems.787gitlab # [ 6.101658] systemd[1]: Starting Rule-based Manager for Device Events and Files...788gitlab # [ 6.103291] systemd[1]: Finished Flush Journal to Persistent Storage.789gitlab # [ 6.112857] systemd-udevd[355]: Using default interface naming scheme 'v261'.790gitlab # [ 6.121142] systemd[1]: Finished Coldplug All udev Devices.791gitlab # [ 6.143990] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 6.211660] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.234161] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.236946] (udev-worker)[416]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 6.238455] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.796gitlab # [ 6.244166] (udev-worker)[420]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.797gitlab # [ 6.246579] (udev-worker)[420]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.263236] systemd[1]: Condition check resulted in Virtio network device being skipped.799gitlab # [ 6.265159] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore800gitlab # [ 6.266663] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67801gitlab # [ 6.268987] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore802gitlab # [ 6.270543] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.271856] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.459779] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3805gitlab # [ 6.318121] systemd[1]: Finished Firewall.806gitlab # [ 6.466920] mousedev: PS/2 mouse device common for all mice807gitlab # [ 6.472932] rtc_cmos 00:05: RTC can wake from S4808gitlab # [ 6.478573] rtc_cmos 00:05: registered as rtc0809gitlab # [ 6.479558] rtc_cmos 00:05: setting system clock to 2026-09-03T10:13:06 UTC (1788430386)810gitlab # [ 6.480891] Floppy drive(s): fd0 is 2.88M AMI BIOS811gitlab # [ 6.481605] systemd-journald[321]: Time jumped backwards, rotating.812gitlab # [ 6.482045] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs813gitlab # [ 6.486230] parport_pc 00:03: reported by Plug and Play ACPI814gitlab # [ 6.487223] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]815gitlab # [ 6.491848] FDC 0 is a S82078B816gitlab # [ 6.495792] ACPI: button: Power Button [PWRF]817gitlab # [ 6.504238] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0818gitlab # [ 6.505623] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD819gitlab # [ 6.506865] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console820gitlab # [ 6.529750] Console: switching to colour dummy device 80x25821gitlab # [ 6.530628] [drm] Found bochs VGA, ID 0xb0c5.822gitlab # [ 6.530631] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.823gitlab # [ 6.535286] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4824gitlab # [ 6.555886] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic825gitlab # [ 6.558615] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0826gitlab # [ 6.594574] Console: switching to colour frame buffer device 160x50827gitlab # [ 6.597370] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device828gitlab # [ 6.598449] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6829gitlab # [ 6.603413] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5830gitlab # [ 6.477156] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.492121] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.493532] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.495762] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.652232] ppdev: user-space parallel port driver835gitlab # [ 6.658444] erofs (device vdb): failed to read inode meta block (nid: 128909289): -4836gitlab # [ 6.515086] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.837gitlab # [ 6.516324] systemd[1]: Stopped Virtual Console Setup.838gitlab # [ 6.519079] systemd[1]: Starting Virtual Console Setup...839gitlab # [ 6.687768] kvm_amd: TSC scaling supported840gitlab # [ 6.688450] kvm_amd: Nested Virtualization enabled841gitlab # [ 6.689067] kvm_amd: Nested Paging enabled842gitlab # [ 6.689727] kvm_amd: LBR virtualization supported843gitlab # [ 6.690309] kvm_amd: Virtual VMLOAD VMSAVE supported844gitlab # [ 6.691130] kvm_amd: Virtual GIF supported845gitlab # [ 6.691777] kvm_amd: Virtual NMI enabled846gitlab # [ 6.726386] EDAC MC: Ver: 3.0.0847gitlab # [ 6.588026] systemd-vconsole-setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones.848gitlab # [ 6.590054] systemd[1]: Finished Virtual Console Setup.849gitlab # [ 6.813497] systemd[1]: Mounting /run/wrappers...850gitlab # [ 6.843583] systemd[1]: Mounted /run/wrappers.851gitlab # [ 6.845324] systemd[1]: Reached target Local File Systems.852gitlab # [ 6.847247] systemd[1]: Listening on Boot Loader Control Service Socket.853gitlab # [ 6.849555] systemd[1]: Starting register-nix-paths.service...854gitlab # [ 6.852056] systemd[1]: Starting Create SUID/SGID Wrappers...855gitlab # [ 6.854459] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.856gitlab # [ 6.857778] systemd[1]: Starting Save Transient machine-id to Disk...857gitlab # [ 6.864375] systemd[1]: Starting Create System Files and Directories...858gitlab # [ 6.891764] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.859gitlab # [ 6.897811] systemd[1]: Finished Save Transient machine-id to Disk.860gitlab # [ 6.906643] systemd[1]: Finished Create System Files and Directories.861gitlab # [ 6.910646] systemd[1]: Starting Rebuild Journal Catalog...862gitlab # [ 6.913084] systemd[1]: Starting Record System Boot/Shutdown in UTMP...863gitlab # [ 6.935884] systemd[1]: Finished Record System Boot/Shutdown in UTMP.864gitlab # [ 6.952268] systemd[1]: Finished Rebuild Journal Catalog.865gitlab # [ 6.954468] systemd[1]: Starting Update is Completed...866gitlab # [ 6.971607] systemd[1]: Finished Update is Completed.867gitlab # [ 7.016262] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.868gitlab # [ 7.018809] systemd[1]: Finished Create SUID/SGID Wrappers.869gitlab # [ 7.273436] systemd[1]: Finished register-nix-paths.service.870gitlab # [ 7.275544] systemd[1]: Reached target System Initialization.871gitlab # [ 7.277530] systemd[1]: Started Discard unused filesystem blocks once a week.872gitlab # [ 7.279942] systemd[1]: Started logrotate.timer.873gitlab # [ 7.281613] systemd[1]: Started Daily Cleanup of Temporary Directories.874gitlab # [ 7.283808] systemd[1]: Reached target Timer Units.875gitlab # [ 7.285487] systemd[1]: Listening on D-Bus System Message Bus Socket.876gitlab # [ 7.287628] systemd[1]: Listening on Nix Daemon Socket.877gitlab # [ 7.289468] systemd[1]: Starting nixbot CI service socket...878gitlab # [ 7.291387] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.879gitlab # [ 7.294251] systemd[1]: Starting D-Bus System Message Bus...880gitlab # [ 7.296243] systemd[1]: Listening on nixbot CI service socket.881gitlab # [ 7.298320] systemd[1]: Reached target Socket Units.882gitlab # [ 7.350260] dbus-broker-launch[577]: Looking up NSS user entry for 'systemd-timesync'...883gitlab # [ 7.353516] dbus-broker-launch[577]: NSS returned no entry for 'systemd-timesync'884gitlab # [ 7.356253] dbus-broker-launch[577]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"885gitlab # [ 7.361385] systemd[1]: Started D-Bus System Message Bus.886gitlab # [ 7.382613] dbus-broker-launch[577]: Ready887gitlab # [ 7.386943] systemd[1]: Reached target Basic System.888gitlab # [ 7.389951] systemd[1]: Started backdoor.service.889gitlab # [ 7.393184] systemd[1]: Starting gitlab-config.service...890gitlab # [ 7.396930] systemd[1]: Starting Import lastlog data into lastlog2 database...891gitlab # [ 7.411489] systemd[1]: Starting Logrotate configuration check...892gitlab # [ 7.416436] systemd[1]: Starting Name Service Cache Daemon (nsncd)...893gitlab # [ 7.422588] systemd[1]: Starting Post-Boot Actions...894gitlab # [ 7.427484] systemd[1]: Started Reset console on configuration changes.895gitlab # connecting to host...896gitlab # [ 7.436246] systemd[1]: Starting resolvconf update...897gitlab # [ 7.439377] logrotate[582]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.898gitlab # [ 7.439538] logrotate[582]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf899gitlab # [ 7.440904] logrotate[582]: note: 'monthly' overrides previously specified 'weekly'900gitlab # [ 7.445736] logrotate[582]: Reading state from file: /var/lib/logrotate.status901gitlab # [ 7.446770] logrotate[582]: state file /var/lib/logrotate.status does not exist902gitlab # [ 7.447931] logrotate[582]: Allocating hash table for state file, size 64 entries903gitlab # [ 7.450342] logrotate[582]: Handling 4 logs904gitlab # [ 7.451204] logrotate[582]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed905gitlab # [ 7.452333] logrotate[582]: considering log /var/log/btmp906gitlab # [ 7.452431] logrotate[582]: Creating new state907gitlab # [ 7.453337] logrotate[582]: Now: 2026-09-03 10:13908gitlab # [ 7.454237] logrotate[582]: Last rotated at 2026-09-03 10:00909gitlab # [ 7.455125] logrotate[582]: log does not need rotating (log has already been rotated)910gitlab # [ 7.455422] logrotate[582]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed911gitlab # [ 7.456330] logrotate[582]: considering log /var/log/wtmp912gitlab # [ 7.457115] logrotate[582]: Creating new state913gitlab # [ 7.457398] logrotate[582]: Now: 2026-09-03 10:13914gitlab # [ 7.457909] logrotate[582]: Last rotated at 2026-09-03 10:00915gitlab # [ 7.458583] logrotate[582]: log does not need rotating (log has already been rotated)916gitlab # [ 7.459060] logrotate[582]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed917gitlab # [ 7.459545] logrotate[582]: switching euid from 0 to 165 and egid from 0 to 165 (pid 582)918gitlab # [ 7.460087] logrotate[582]: considering log /var/gitlab/state/log/*.log919gitlab # [ 7.460545] logrotate[582]: log /var/gitlab/state/log/*.log does not exist -- skipping920gitlab # [ 7.461065] logrotate[582]: Creating new state921gitlab # [ 7.461530] logrotate[582]: switching euid from 165 to 0 and egid from 165 to 0 (pid 582)922gitlab # [ 7.462091] logrotate[582]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed923gitlab # [ 7.462573] logrotate[582]: switching euid from 0 to 60 and egid from 0 to 60 (pid 582)924gitlab # [ 7.463080] logrotate[582]: considering log /var/log/nginx/*.log925gitlab # [ 7.463567] logrotate[582]: log /var/log/nginx/*.log does not exist -- skipping926gitlab # [ 7.464077] logrotate[582]: Creating new state927gitlab # [ 7.464574] logrotate[582]: not running postrotate script, since no logs were rotated928gitlab # [ 7.465118] logrotate[582]: switching euid from 60 to 0 and egid from 60 to 0 (pid 582)929gitlab # [ 7.484070] systemd[1]: Finished Logrotate configuration check.930gitlab # [ 7.484853] systemd[1]: Finished Post-Boot Actions.931gitlab # [ 7.486219] systemd[1]: Finished Import lastlog data into lastlog2 database.932gitlab # [ 7.494605] nsncd[583]: Sep 03 10:13:07.659 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"933gitlab: Guest shell says: b'Spawning backdoor root shell...\n'934gitlab # [ 7.497109] systemd[1]: Started Name Service Cache Daemon (nsncd).935gitlab # [ 7.497914] systemd[1]: Reached target Host and Network Name Lookups.936gitlab: connected to guest root shell937gitlab # [ 7.498377] systemd[1]: Reached target User and Group Name Lookups.938gitlab: (connecting took 8.12 seconds)939gitlab # [ 7.502572] systemd[1]: Starting User Login Management...940gitlab: (finished: waiting for the VM to finish booting, in 8.12 seconds)941gitlab # [ 7.539658] systemd[1]: Stopped target Host and Network Name Lookups.942gitlab # [ 7.540233] systemd[1]: Stopping Host and Network Name Lookups...943gitlab # [ 7.540969] systemd[1]: Stopped target User and Group Name Lookups.944gitlab # [ 7.541668] systemd[1]: Stopping User and Group Name Lookups...945gitlab # [ 7.544279] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...946gitlab # [ 7.545954] systemd-logind[626]: New seat seat0.947gitlab # [ 7.547131] systemd[1]: nscd.service: Deactivated successfully.948gitlab # [ 7.548259] systemd[1]: Stopped Name Service Cache Daemon (nsncd).949gitlab # [ 7.550074] systemd[1]: nscd.service: Consumed 19ms CPU time over 129ms wall clock time, 7.3M memory peak, 5.5M read from disk.950gitlab # [ 7.552172] systemd-logind[626]: Watching system buttons on /dev/input/event2 (Power Button)951gitlab # [ 7.554709] systemd-logind[626]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)952gitlab # [ 7.556049] systemd-logind[626]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)953gitlab # [ 7.557472] systemd[1]: Started User Login Management.954gitlab # [ 7.558328] systemd[1]: Starting linger-users.service...955gitlab # [ 7.559194] systemd[1]: Starting Name Service Cache Daemon (nsncd)...956gitlab # [ 7.570450] systemd[1]: linger-users.service: Deactivated successfully.957gitlab # [ 7.572160] systemd[1]: Finished linger-users.service.958gitlab # [ 7.574892] nsncd[674]: Sep 03 10:13:07.740 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"959gitlab # [ 7.577721] systemd[1]: Started Name Service Cache Daemon (nsncd).960gitlab # [ 7.578165] systemd[1]: Reached target Host and Network Name Lookups.961gitlab # [ 7.578275] systemd[1]: Reached target User and Group Name Lookups.962gitlab # [ 7.585533] systemd[1]: Finished resolvconf update.963gitlab # [ 7.586734] systemd[1]: Reached target Preparation for Network.964gitlab # [ 7.589501] systemd[1]: Starting DHCP Client...965gitlab # [ 7.590899] systemd[1]: Starting Address configuration of eth1...966gitlab # [ 7.592872] systemd[1]: Starting Extra networking commands....967gitlab # [ 7.625590] network-addresses-eth1-start[700]: adding address 192.168.1.1/24... done968gitlab # [ 7.629316] network-addresses-eth1-start[700]: adding address 2001:db8:1::1/64... done969gitlab # [ 7.634648] systemd[1]: Finished Address configuration of eth1.970gitlab # [ 7.665043] dhcpcd[710]: dhcpcd-10.3.2 starting971gitlab # [ 7.667899] dhcpcd[763]: dev: loaded udev972gitlab # [ 7.670503] systemd[1]: Finished Extra networking commands..973gitlab # [ 7.671576] systemd[1]: Reached target Network.974gitlab # [ 7.673446] systemd[1]: Start[ 7.819127] 8021q: 802.1Q VLAN Support v1.8975gitlab # ing gitlab-workhorse.service...[ 7.819966] 8021q: adding VLAN 0 to HW filter on device eth1976gitlab # 977gitlab # [ 7.678316] systemd[1]: Starting Nginx Web Server...978gitlab # [ 7.681528] systemd[1]: Starting PostgreSQL Server...979gitlab # [ 7.683730] systemd[1]: Starting Redis Server - redis-gitlab...980gitlab # [ 7.690306] systemd[1]: Starting Permit User Sessions...981gitlab # [ 7.701585] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.982gitlab # [ 7.714414] systemd[1]: Finished Permit User Sessions.983gitlab # [ 7.718986] systemd[1]: Started Getty on tty1.984gitlab # [ 7.721812] systemd[1]: Reached target Login Prompts.985gitlab # [ 7.911783] cfg80211: Loading compiled-in X.509 certificates for regulatory database986gitlab # [ 7.917301] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'987gitlab # [ 7.918228] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'988gitlab # [ 7.920609] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2989gitlab # [ 7.921767] cfg80211: failed to load regulatory.db990gitlab # [ 7.945469] 8021q: adding VLAN 0 to HW filter on device eth0991gitlab # [ 7.801520] dhcpcd[763]: eth0: waiting for carrier992gitlab # [ 7.801923] dhcpcd[763]: eth0: carrier acquired993gitlab # [ 7.807072] dhcpcd[763]: DUID 00:01:00:01:32:2c:04:b3:52:54:00:12:34:56994gitlab # [ 7.807205] dhcpcd[763]: eth0: IAID 00:12:34:56995gitlab # [ 7.807752] dhcpcd[763]: eth0: adding address fe80::5054:ff:fe12:3456996gitlab # [ 7.825295] nginx-pre-start[790]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok997gitlab # [ 7.825621] nginx-pre-start[790]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful998gitlab # [ 7.831036] systemd[1]: Started Nginx Web Server.999gitlab # [ 7.850810] postgresql-pre-start[795]: The files belonging to this database system will be owned by user "postgres".1000gitlab # [ 7.851206] postgresql-pre-start[795]: This user must also own the server process.1001gitlab # [ 7.855208] postgresql-pre-start[795]: The database cluster will be initialized with locale "en_US.UTF-8".1002gitlab # [ 7.855521] postgresql-pre-start[795]: The default database encoding has accordingly been set to "UTF8".1003gitlab # [ 7.855967] postgresql-pre-start[795]: The default text search configuration will be set to "english".1004gitlab # [ 7.856628] postgresql-pre-start[795]: Data page checksums are enabled.1005gitlab # [ 7.857182] postgresql-pre-start[795]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1006gitlab # [ 7.858409] postgresql-pre-start[795]: creating subdirectories ... ok1007gitlab # [ 7.860064] postgresql-pre-start[795]: selecting dynamic shared memory implementation ... posix1008gitlab # [ 7.862754] redis-server[788]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1009gitlab # [ 7.863164] redis-server[788]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1010gitlab # [ 7.863819] redis-server[788]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=788, just started1011gitlab # [ 7.864430] redis-server[788]: Configuration loaded1012gitlab # [ 7.866548] redis[788]: monotonic clock: POSIX clock_gettime1013gitlab # [ 7.867509] redis[788]: Running mode=standalone, port=0.1014gitlab # [ 7.867986] redis[788]: Server initialized1015gitlab # [ 7.868622] redis[788]: Ready to accept connections unix1016gitlab # [ 7.869429] redis[788]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1017gitlab # [ 7.874100] systemd[1]: Started Redis Server - redis-gitlab.1018gitlab # [ 7.903571] postgresql-pre-start[795]: selecting default "max_connections" ... 1001019gitlab # [ 7.941392] postgresql-pre-start[795]: selecting default "shared_buffers" ... 128MB1020gitlab # [ 8.186799] systemd[1]: Started gitlab-workhorse.service.1021gitlab # [ 8.299319] postgresql-pre-start[795]: selecting default time zone ... UTC1022gitlab # [ 8.300492] postgresql-pre-start[795]: creating configuration files ... ok1023gitlab # [ 8.440372] gitlab-workhorse[825]: time="2026-09-03T10:13:08Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41024gitlab # [ 8.440595] gitlab-workhorse[825]: time="2026-09-03T10:13:08Z" level=info msg="Using redis/go-redis"1025gitlab # [ 8.441088] gitlab-workhorse[825]: time="2026-09-03T10:13:08Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1026gitlab # [ 8.455952] postgresql-pre-start[795]: running bootstrap script ... ok1027gitlab # [ 8.890177] postgresql-pre-start[795]: performing post-bootstrap initialization ... ok1028gitlab # [ 9.179090] dhcpcd[763]: eth0: soliciting a DHCP lease1029gitlab # [ 9.336670] NET: Registered PF_PACKET protocol family1030gitlab # [ 9.199224] dhcpcd[763]: eth0: offered 10.0.2.15 from 10.0.2.21031gitlab # [ 9.203351] dhcpcd[763]: eth0: probing address 10.0.2.15/241032gitlab # [ 9.494199] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[852]: mkdir -p /var/gitlab/state/home/.ssh: OK1033gitlab # [ 9.496297] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[852]: chmod 700 /var/gitlab/state/home/.ssh: OK1034gitlab # [ 9.577945] systemd[1]: Finished gitlab-config.service.1035gitlab # [ 9.584679] systemd[1]: Started gitaly.service.1036gitlab # [ 9.587443] postgresql-pre-start[795]: syncing data to disk ... ok1037gitlab # [ 9.587687] postgresql-pre-start[795]: initdb: warning: enabling "trust" authentication for local connections1038gitlab # [ 9.590822] postgresql-pre-start[795]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1039gitlab # [ 9.592536] postgresql-pre-start[795]: Success. You can now start the database server using:1040gitlab # [ 9.593587] postgresql-pre-start[795]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1041gitlab # [ 9.698220] postgres[874]: [874] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1042gitlab # [ 9.702906] postgres[874]: [874] LOG: listening on IPv6 address "::1", port 54321043gitlab # [ 9.705837] postgres[874]: [874] LOG: listening on IPv4 address "127.0.0.1", port 54321044gitlab # [ 9.708658] postgres[874]: [874] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1045gitlab # [ 9.716410] postgres[889]: [889] LOG: database system was shut down at 2026-09-03 10:13:09 GMT1046gitlab # [ 9.729475] postgres[874]: [874] LOG: database system is ready to accept connections1047gitlab # [ 9.734323] systemd[1]: Started PostgreSQL Server.1048gitlab # [ 9.739160] systemd[1]: Starting PostgreSQL Setup Scripts...1049gitlab # [ 9.961944] postgresql-setup-start[905]: CREATE DATABASE1050gitlab # [ 9.992484] postgresql-setup-start[912]: CREATE ROLE1051gitlab # [ 10.005733] postgresql-setup-start[914]: ALTER DATABASE1052gitlab # [ 10.029335] postgresql-setup-start[919]: CREATE ROLE1053gitlab # [ 10.031488] systemd[1]: Finished PostgreSQL Setup Scripts.1054gitlab # [ 10.032762] systemd[1]: Reached target PostgreSQL.1055gitlab # [ 10.034476] systemd[1]: Starting gitlab-db-config.service...1056gitlab # [ 10.035723] systemd[1]: Starting gitlab-postgresql.service...1057gitlab # [ 10.134609] gitaly[870]: time="2026-09-03T10:13:10.299Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8701058gitlab # [ 10.134869] gitaly[870]: time="2026-09-03T10:13:10.300Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8701059gitlab # [ 10.135546] gitaly[870]: time="2026-09-03T10:13:10.300Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8701060gitlab # [ 10.136286] gitlab-postgresql-start[929]: CREATE DATABASE1061gitlab # [ 10.138382] gitaly[870]: time="2026-09-03T10:13:10.300Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8701062gitlab # [ 10.139449] gitaly[870]: time="2026-09-03T10:13:10.303Z" level=info msg="Starting Gitaly" pid=870 version=1063gitlab # [ 10.184568] gitlab-postgresql-start[934]: CREATE EXTENSION1064gitlab # [ 10.289337] gitlab-postgresql-start[937]: CREATE EXTENSION1065gitlab # [ 10.291794] systemd[1]: Finished gitlab-postgresql.service.1066gitlab # [ 10.293118] dhcpcd[763]: eth0: soliciting an IPv6 router1067gitlab # [ 10.293649] dhcpcd[763]: eth0: Router Advertisement from fe80::21068gitlab # [ 10.294102] dhcpcd[763]: eth0: adding address fec0::5054:ff:fe12:3456/641069gitlab # [ 10.294604] dhcpcd[763]: eth0: adding route to fec0::/641070gitlab # [ 10.295845] dhcpcd[763]: eth0: adding default route via fe80::21071gitlab # [ 10.330235] gitaly[870]: time="2026-09-03T10:13:10.495Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=191 pid=8701072gitlab # [ 10.330449] gitaly[870]: time="2026-09-03T10:13:10.496Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8701073gitlab # [ 10.330911] gitaly[870]: time="2026-09-03T10:13:10.496Z" level=info msg="finished initializing command factory" duration_ms=0 pid=8701074gitlab # [ 10.331577] gitaly[870]: time="2026-09-03T10:13:10.496Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-870/git-exec-2436825222.d/git pid=8701075gitlab # [ 10.340025] gitaly[870]: time="2026-09-03T10:13:10.505Z" level=info msg="finished detecting git version" duration_ms=9 pid=8701076gitlab # [ 10.340771] gitaly[870]: time="2026-09-03T10:13:10.506Z" level=info msg="using Git version" pid=870 version=2.53.g1077gitlab # [ 10.344247] gitaly[870]: time="2026-09-03T10:13:10.507Z" level=info msg="clearing disk cache object folder" pid=870 storage=default1078gitlab # [ 10.345875] gitaly[870]: time="2026-09-03T10:13:10.507Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache53585953 pid=870 storage=default1079gitlab # [ 10.351150] gitaly[870]: time="2026-09-03T10:13:10.507Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache53585953 pid=870 storage=default1080gitlab # [ 10.351457] gitaly[870]: time="2026-09-03T10:13:10.507Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8701081gitlab # [ 10.351922] gitaly[870]: time="2026-09-03T10:13:10.507Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8701082gitlab # [ 10.352606] gitaly[870]: time="2026-09-03T10:13:10.508Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache53585953 clear_duration_ms=0 pid=870 storage=default1083gitlab # [ 10.394399] gitaly[870]: time="2026-09-03T10:13:10.559Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8701084gitlab # [ 10.394567] gitaly[870]: time="2026-09-03T10:13:10.560Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=870 schema=unix1085gitlab # [ 10.395046] gitaly[870]: time="2026-09-03T10:13:10.560Z" level=info msg="listening at address" address=/run/gitaly/gitaly-870/sock.d/intern pid=870 schema=unix1086gitlab # [ 10.395560] gitaly[870]: time="2026-09-03T10:13:10.560Z" level=info msg="finished tempdir cleaner walk" pid=870 storage=default time_ms=01087gitlab # [ 10.396028] gitaly[870]: time="2026-09-03T10:13:10.560Z" level=info msg="counting repositories" pid=8701088gitlab # [ 10.396531] gitaly[870]: time="2026-09-03T10:13:10.560Z" level=info msg="starting to count repositories" pid=870 storage_path=/var/gitlab/state/repositories1089gitlab # [ 10.399063] gitaly[870]: time="2026-09-03T10:13:10.560Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=870 storage_path=/var/gitlab/state/repositories1090gitlab # [ 10.399750] gitaly[870]: time="2026-09-03T10:13:10.560Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8701091gitlab # [ 10.400206] gitaly[870]: time="2026-09-03T10:13:10.561Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8701092gitlab # [ 10.400673] gitaly[870]: time="2026-09-03T10:13:10.561Z" level=info msg="Started Gitaly" duration_ms=257 pid=8701093gitlab # [ 10.401140] gitaly[870]: time="2026-09-03T10:13:10.562Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8701094gitlab # [ 10.401618] gitaly[870]: time="2026-09-03T10:13:10.562Z" level=info msg="maintenance: daily scheduled" pid=870 scheduled="2026-09-03 12:00:00 +0000 UTC"1095gitlab # [ 11.588165] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1096gitlab # [ 11.588644] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1097gitlab # [ 11.626661] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1098gitlab # [ 12.348971] gitaly[870]: time="2026-09-03T10:13:12.513Z" level=info msg="License database preloaded" duration_ms=2213 pid=8701099gitlab # [ 14.100068] dhcpcd[763]: eth0: leased 10.0.2.15 for 86400 seconds1100gitlab # [ 14.100447] dhcpcd[763]: eth0: adding route to 10.0.2.0/241101gitlab # [ 14.101987] dhcpcd[763]: eth0: adding default route via 10.0.2.21102gitlab # [ 14.226235] systemd[1]: Started DHCP Client.1103gitlab # [ 14.226983] systemd[1]: Reached target Network is Online.1104gitlab # [ 42.190838] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[924]: W, [2026-09-03T10:13:42.355727 #924] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1105gitlab # [ 44.062267] postgres[1317]: [1317] ERROR: relation "feature_gates" does not exist at character 5231106gitlab # [ 44.063379] postgres[1317]: [1317] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1107gitlab # [ 44.063980] postgres[1317]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1108gitlab # [ 44.064819] postgres[1317]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1109gitlab # [ 44.065793] postgres[1317]: attidentity AS identity,1110gitlab # [ 44.066665] postgres[1317]: attgenerated as attgenerated1111gitlab # [ 44.067633] postgres[1317]: FROM pg_attribute a1112gitlab # [ 44.068442] postgres[1317]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1113gitlab # [ 44.069538] postgres[1317]: LEFT JOIN pg_type t ON a.atttypid = t.oid1114gitlab # [ 44.070538] postgres[1317]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1115gitlab # [ 44.071528] postgres[1317]: WHERE a.attrelid = '"feature_gates"'::regclass1116gitlab # [ 44.072510] postgres[1317]: AND a.attnum > 0 AND NOT a.attisdropped1117gitlab # [ 44.073457] postgres[1317]: ORDER BY a.attnum1118gitlab # [ 44.074515] postgres[1317]:1119gitlab # [ 48.121119] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1359]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1120gitlab # [ 48.121570] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1359]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1121gitlab # [ 48.487500] gitlab-workhorse[825]: time="2026-09-03T10:13:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 58.496795] gitlab-workhorse[825]: time="2026-09-03T10:13:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1123gitlab # [ 65.552232] postgres[1434]: [1434] ERROR: relation "table_without_models" does not exist1124gitlab # [ 65.552835] postgres[1434]: [1434] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1125gitlab # [ 68.506247] gitlab-workhorse[825]: time="2026-09-03T10:14:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1126gitlab # [ 78.507315] gitlab-workhorse[825]: time="2026-09-03T10:14:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1127gitlab # [ 78.627895] systemd[1]: Finished gitlab-db-config.service.1128gitlab # [ 78.632964] systemd[1]: Started gitlab-sidekiq.service.1129gitlab # [ 78.635995] systemd[1]: Starting gitlab.service...1130gitlab # [ 79.018075] bundle[1628]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1131gitlab # [ 79.018954] bundle[1628]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1132gitlab # [ 79.019644] bundle[1628]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1133gitlab # [ 81.828469] bundle[1628]: {"timestamp":"2026-09-03T10:14:21.973Z","pid":1628,"message":"* Enabling systemd notification integration"}1134gitlab # [ 81.828986] bundle[1628]: {"timestamp":"2026-09-03T10:14:21.993Z","pid":1628,"message":"Puma starting in cluster mode..."}1135gitlab # [ 81.829805] bundle[1628]: {"timestamp":"2026-09-03T10:14:21.993Z","pid":1628,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1136gitlab # [ 81.830880] bundle[1628]: {"timestamp":"2026-09-03T10:14:21.993Z","pid":1628,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1137gitlab # [ 81.831646] bundle[1628]: {"timestamp":"2026-09-03T10:14:21.993Z","pid":1628,"message":"* Min threads: 0"}1138gitlab # [ 81.832540] bundle[1628]: {"timestamp":"2026-09-03T10:14:21.993Z","pid":1628,"message":"* Max threads: 4"}1139gitlab # [ 81.833458] bundle[1628]: {"timestamp":"2026-09-03T10:14:21.993Z","pid":1628,"message":"* Environment: production"}1140gitlab # [ 81.834209] bundle[1628]: {"timestamp":"2026-09-03T10:14:21.993Z","pid":1628,"message":"* Master PID: 1628"}1141gitlab # [ 81.835075] bundle[1628]: {"timestamp":"2026-09-03T10:14:21.993Z","pid":1628,"message":"* Workers: 2"}1142gitlab # [ 81.835848] bundle[1628]: {"timestamp":"2026-09-03T10:14:21.993Z","pid":1628,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1143gitlab # [ 81.836716] bundle[1628]: {"timestamp":"2026-09-03T10:14:21.993Z","pid":1628,"message":"* Preloading application"}1144gitlab # [ 82.003595] sidekiq-cluster[1627]: {"severity":"INFO","time":"2026-09-03T10:14:22.151Z","message":"Starting cluster with 1 processes"}1145gitlab # [ 88.517675] gitlab-workhorse[825]: time="2026-09-03T10:14:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1146gitlab # [ 98.519090] gitlab-workhorse[825]: time="2026-09-03T10:14:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1147gitlab # [ 104.888173] bundle[1628]: W, [2026-09-03T10:14:45.053033 #1628] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1148gitlab # [ 108.528952] gitlab-workhorse[825]: time="2026-09-03T10:14:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1149gitlab # [ 108.931831] sidekiq-cluster[1658]: 2026-09-03T10:14:49.096Z pid=1658 tid=wk2 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1658, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>450224128}1150gitlab # [ 109.106325] sidekiq-cluster[1658]: W, [2026-09-03T10:14:49.271749 #1658] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1151gitlab # [ 109.147059] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:49.312Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1152gitlab # [ 111.202109] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.366Z","message":"GitLab reliable fetch activated!"}1153gitlab # [ 111.206409] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.366Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1154gitlab # [ 111.227600] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.393Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1155gitlab # [ 111.232917] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.395Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1156gitlab # [ 111.233071] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.397Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1157gitlab # [ 111.243916] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.409Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1158gitlab # [ 111.252253] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.417Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1159gitlab # [ 111.259573] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.425Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1160gitlab # [ 111.266526] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.432Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1161gitlab # [ 111.273155] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.438Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1162gitlab # [ 111.279534] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.445Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1163gitlab # [ 111.285040] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.450Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1164gitlab # [ 111.290896] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.456Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1165gitlab # [ 111.297146] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.462Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1166gitlab # [ 111.302391] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.468Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1167gitlab # [ 111.306043] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.471Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1168gitlab # [ 111.309920] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.475Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1169gitlab # [ 111.313889] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.479Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1170gitlab # [ 111.318052] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.483Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1171gitlab # [ 111.322249] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.487Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1172gitlab # [ 111.326647] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.492Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1173gitlab # [ 111.330656] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.496Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1174gitlab # [ 111.334914] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.500Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1175gitlab # [ 111.338775] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.504Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1176gitlab # [ 111.342324] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.508Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1177gitlab # [ 111.346132] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.511Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1178gitlab # [ 111.350028] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.515Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1179gitlab # [ 111.353904] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.519Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1180gitlab # [ 111.357733] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.523Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1181gitlab # [ 111.361597] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.527Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1182gitlab # [ 111.365615] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.531Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1183gitlab # [ 111.371083] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.536Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1184gitlab # [ 111.375127] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.540Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1185gitlab # [ 111.379662] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.545Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1186gitlab # [ 111.383557] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.549Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1187gitlab # [ 111.387518] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.553Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1188gitlab # [ 111.391580] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.557Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1189gitlab # [ 111.395297] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.560Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1190gitlab # [ 111.399462] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.565Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1191gitlab # [ 111.403537] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.569Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1192gitlab # [ 111.408442] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.574Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1193gitlab # [ 111.413272] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.578Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1194gitlab # [ 111.418419] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.584Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1195gitlab # [ 111.422958] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.588Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1196gitlab # [ 111.428140] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.593Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1197gitlab # [ 111.433606] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.599Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1198gitlab # [ 111.439497] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.605Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1199gitlab # [ 111.444792] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.610Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1200gitlab # [ 111.449518] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.615Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1201gitlab # [ 111.454555] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.620Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1202gitlab # [ 111.458717] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.624Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1203gitlab # [ 111.463523] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.629Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1204gitlab # [ 111.467630] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.633Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1205gitlab # [ 111.492581] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.657Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1206gitlab # [ 111.503065] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.668Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1207gitlab # [ 111.510281] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.675Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1208gitlab # [ 111.519705] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.685Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1209gitlab # [ 111.528875] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.694Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1210gitlab # [ 111.533365] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.699Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1211gitlab # [ 111.537581] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.703Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1212gitlab # [ 111.542364] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.707Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1213gitlab # [ 111.547583] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.713Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1214gitlab # [ 111.551259] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.716Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1215gitlab # [ 111.556272] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.721Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1216gitlab # [ 111.560667] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.726Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1217gitlab # [ 111.566680] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.732Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1218gitlab # [ 111.571418] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.737Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1219gitlab # [ 111.574768] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.740Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1220gitlab # [ 111.577679] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.743Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1221gitlab # [ 111.579901] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.745Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1222gitlab # [ 111.582200] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.747Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1223gitlab # [ 111.584648] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.749Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1224gitlab # [ 111.586143] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.751Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1225gitlab # [ 111.591050] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.756Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1226gitlab # [ 111.594476] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.760Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1227gitlab # [ 111.600157] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.765Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1228gitlab # [ 111.603973] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.769Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1229gitlab # [ 111.608636] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.774Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1230gitlab # [ 111.612574] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.778Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1231gitlab # [ 111.616574] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.782Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1232gitlab # [ 111.620238] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.785Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1233gitlab # [ 111.623961] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.789Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1234gitlab # [ 111.628479] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.794Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1235gitlab # [ 111.632239] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.797Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1236gitlab # [ 111.636840] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.802Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1237gitlab # [ 111.640857] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.806Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1238gitlab # [ 111.645176] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.810Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1239gitlab # [ 111.648113] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.812Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1240gitlab # [ 111.651784] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.817Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1241gitlab # [ 111.656302] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.821Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1242gitlab # [ 111.660507] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.826Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1243gitlab # [ 111.665058] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.830Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1244gitlab # [ 111.669106] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.834Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1245gitlab # [ 111.674209] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.839Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1246gitlab # [ 111.678431] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.844Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1247gitlab # [ 111.682762] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.848Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1248gitlab # [ 111.687299] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.852Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1249gitlab # [ 111.695172] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.860Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1250gitlab # [ 111.698394] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.864Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1251gitlab # [ 111.703649] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.869Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1252gitlab # [ 111.725215] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.890Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1253gitlab # [ 111.730189] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.895Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1254gitlab # [ 111.735051] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.900Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1255gitlab # [ 111.741314] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.906Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1256gitlab # [ 111.746791] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.912Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1257gitlab # [ 111.752119] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.917Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1258gitlab # [ 111.757522] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.923Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1259gitlab # [ 111.762524] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.928Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1260gitlab # [ 111.767734] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.933Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1261gitlab # [ 111.773975] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.939Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1262gitlab # [ 111.780771] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:14:51.946Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1263gitlab # [ 114.323341] sidekiq-cluster[1658]: InitializerConnections Query: SET client_min_messages TO 'warning'1264gitlab # [ 114.323660] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1265gitlab # [ 114.325541] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1266gitlab # [ 114.327176] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1267gitlab # [ 114.328273] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1268gitlab # [ 114.329403] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1269gitlab # [ 114.330925] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1270gitlab # [ 114.350793] sidekiq-cluster[1658]: InitializerConnections Query: SET standard_conforming_strings = on1271gitlab # [ 114.351063] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1272gitlab # [ 114.351745] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1273gitlab # [ 114.353237] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1274gitlab # [ 114.354346] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1275gitlab # [ 114.355480] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1276gitlab # [ 114.356599] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1277gitlab # [ 114.373810] sidekiq-cluster[1658]: InitializerConnections Query: SET intervalstyle = iso_86011278gitlab # [ 114.373954] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1279gitlab # [ 114.375151] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1280gitlab # [ 114.375748] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1281gitlab # [ 114.376638] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1282gitlab # [ 114.377831] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1283gitlab # [ 114.379024] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1284gitlab # [ 114.396894] sidekiq-cluster[1658]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1285gitlab # [ 114.397620] sidekiq-cluster[1658]: FROM pg_type as t1286gitlab # [ 114.398566] sidekiq-cluster[1658]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1287gitlab # [ 114.399304] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1288gitlab # [ 114.399960] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1289gitlab # [ 114.400814] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1290gitlab # [ 114.401596] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1291gitlab # [ 114.402439] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1292gitlab # [ 114.403171] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1293gitlab # [ 114.414977] sidekiq-cluster[1658]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1294gitlab # [ 114.415599] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1295gitlab # [ 114.416251] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1296gitlab # [ 114.416988] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1297gitlab # [ 114.417647] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1298gitlab # [ 114.418517] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1299gitlab # [ 114.419354] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1300gitlab # [ 114.428410] sidekiq-cluster[1658]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1301gitlab # [ 114.428808] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1302gitlab # [ 114.429650] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1303gitlab # [ 114.430483] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1304gitlab # [ 114.431263] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1305gitlab # [ 114.431963] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1306gitlab # [ 114.432664] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1307gitlab # [ 118.538539] gitlab-workhorse[825]: time="2026-09-03T10:14:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1308gitlab # [ 128.541424] gitlab-workhorse[825]: time="2026-09-03T10:15:08Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1309gitlab # [ 131.780324] postgres[2124]: [2124] ERROR: relation "table_without_models" does not exist1310gitlab # [ 131.780535] postgres[2124]: [2124] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1311gitlab # [ 132.444059] postgres[2136]: [2136] ERROR: relation "table_without_models" does not exist1312gitlab # [ 132.446342] postgres[2136]: [2136] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1313gitlab # [ 134.423158] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:14.587Z","message":"Booted Rails 7.2.3.1 application in production environment"}1314gitlab # [ 134.428289] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:14.593Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1315gitlab # [ 134.432885] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:14.593Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1316gitlab # [ 134.436908] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:14.594Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1317gitlab # [ 134.441615] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:14.599Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1318gitlab # [ 135.377788] bundle[1628]: {"timestamp":"2026-09-03T10:15:15.542Z","pid":1628,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1319gitlab # [ 135.382193] bundle[1628]: {"timestamp":"2026-09-03T10:15:15.542Z","pid":1628,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1320gitlab # [ 135.386131] bundle[1628]: {"timestamp":"2026-09-03T10:15:15.542Z","pid":1628,"message":"! #\u003cThread:0x000070e3a8efd088 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1321gitlab # [ 135.397765] bundle[1628]: {"timestamp":"2026-09-03T10:15:15.542Z","pid":1628,"message":"! #\u003cThread:0x000070e3a911a370 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1322gitlab # [ 135.409260] bundle[1628]: {"timestamp":"2026-09-03T10:15:15.542Z","pid":1628,"message":"Use Ctrl-C to stop"}1323gitlab # [ 135.412368] bundle[1628]: {"timestamp":"2026-09-03T10:15:15.543Z","pid":1628,"message":"Sending status to systemd every 1.0 sec"}1324gitlab # [ 136.128946] bundle[1628]: {"timestamp":"2026-09-03T10:15:16.294Z","pid":1628,"message":"- Worker 0 (PID: 2183) booted in 0.72s, phase: 0"}1325gitlab # [ 136.174420] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:16.339Z","message":"Cleaning working queues"}1326gitlab # [ 136.175949] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:16.341Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2a03d6d34b4dd247c06f9a7a","created_at":"2026-09-03T10:14:18.166Z","trace_propagation_headers":{"sentry-trace":"cba79585e9b1480699d659e21311154b-256c109fc27f4912","baggage":"sentry-trace_id=cba79585e9b1480699d659e21311154b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1cad46a297093f1828c3d62a854070dc","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-03T10:14:18.174Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2a03d6d34b4dd247c06f9a7a: start","job_status":"start","queue_duration_s":58.167014,"scheduling_latency_s":58.167065}1327gitlab # [ 136.188373] bundle[1628]: {"timestamp":"2026-09-03T10:15:16.351Z","pid":1628,"message":"- Worker 1 (PID: 2187) booted in 0.75s, phase: 0"}1328gitlab # [ 136.190135] systemd[1]: Started gitlab.service.1329gitlab # [ 136.190880] systemd[1]: Reached target Common target for all GitLab services..1330gitlab # [ 136.193127] systemd[1]: Starting setup-gitlab.service...1331gitlab # [ 136.212154] setup-gitlab-start[2225]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1332gitlab # [ 136.330078] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:16.495Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2a03d6d34b4dd247c06f9a7a","created_at":"2026-09-03T10:14:18.166Z","trace_propagation_headers":{"sentry-trace":"cba79585e9b1480699d659e21311154b-256c109fc27f4912","baggage":"sentry-trace_id=cba79585e9b1480699d659e21311154b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1cad46a297093f1828c3d62a854070dc","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-03T10:14:18.174Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2a03d6d34b4dd247c06f9a7a: done: 0.154453 sec","job_status":"done","queue_duration_s":58.167014,"scheduling_latency_s":58.167065,"redis_calls":26,"redis_duration_s":0.005462,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003273,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001257,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.070256416,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.154453,"completed_at":"2026-09-03T10:15:16.495Z","load_balancing_strategy":"primary","db_duration_s":0.034859,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1333gitlab # [ 138.333295] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:15:18 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 21001334gitlab # [ 138.338222] setup-gitlab-start[2225]: + TOKEN=nixbot-test-token-of-20-chars1335gitlab # [ 138.340638] setup-gitlab-start[2225]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1336gitlab # [ 138.355982] runuser[2245]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1337gitlab # [ 138.721546] setup-gitlab-start[2246]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1338gitlab # [ 138.726596] setup-gitlab-start[2246]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1339gitlab # [ 138.731345] setup-gitlab-start[2246]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1340gitlab # [ 139.315638] setup-gitlab-start[2246]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1341gitlab # [ 139.320716] setup-gitlab-start[2246]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1342gitlab # [ 139.325342] setup-gitlab-start[2246]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1343gitlab # [ 147.432573] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:27.597Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"c05f17a583c0e0ce0a643466","created_at":"2026-09-03T10:15:27.566Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01e940b73fd4a71484c2aa29fd470c2a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.595Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-c05f17a583c0e0ce0a643466: start","job_status":"start","queue_duration_s":0.002193,"scheduling_latency_s":0.002238}1344gitlab # [ 147.584774] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:27.749Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"c05f17a583c0e0ce0a643466","created_at":"2026-09-03T10:15:27.566Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01e940b73fd4a71484c2aa29fd470c2a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.595Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-c05f17a583c0e0ce0a643466: done: 0.152363 sec","job_status":"done","queue_duration_s":0.002193,"scheduling_latency_s":0.002238,"redis_calls":17,"redis_duration_s":0.022770000000000002,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.008505,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.003024,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003145,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000944254,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.152363,"completed_at":"2026-09-03T10:15:27.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 147.654721] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:27.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6613b6e502054ced0155b687","created_at":"2026-09-03T10:15:27.644Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e965f24060fb251ad73d9cc475983996","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.658Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6613b6e502054ced0155b687: start","job_status":"start","queue_duration_s":0.098927,"scheduling_latency_s":0.098977}1346gitlab # [ 147.700852] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:27.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6613b6e502054ced0155b687","created_at":"2026-09-03T10:15:27.644Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e965f24060fb251ad73d9cc475983996","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.658Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6613b6e502054ced0155b687: done: 0.10874 sec","job_status":"done","queue_duration_s":0.098927,"scheduling_latency_s":0.098977,"redis_calls":12,"redis_duration_s":0.014561,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000642,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004997,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008922,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001000685,"exclusive_lock_hold_duration_s":0.041726812,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.10874,"completed_at":"2026-09-03T10:15:27.866Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 147.740969] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:27.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3efda8b5b5095a13351da3f9","created_at":"2026-09-03T10:15:27.684Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8720b40368180d253dca9a6bedd137b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.691Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3efda8b5b5095a13351da3f9: start","job_status":"start","queue_duration_s":0.18369,"scheduling_latency_s":0.183708}1348gitlab # [ 147.814778] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:27.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3efda8b5b5095a13351da3f9","created_at":"2026-09-03T10:15:27.684Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8720b40368180d253dca9a6bedd137b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.691Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3efda8b5b5095a13351da3f9: done: 0.104142 sec","job_status":"done","queue_duration_s":0.18369,"scheduling_latency_s":0.183708,"redis_calls":14,"redis_duration_s":0.021661,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.015073,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004021,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002567,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001028622,"exclusive_lock_hold_duration_s":0.034713908999999994,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.104142,"completed_at":"2026-09-03T10:15:27.979Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 147.834814] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:27.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"753e829d887ea2e7f474cd8a","created_at":"2026-09-03T10:15:27.700Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"310d57006ce4b7abbf0b472adc537415","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.712Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-753e829d887ea2e7f474cd8a: start","job_status":"start","queue_duration_s":0.270373,"scheduling_latency_s":0.2704}1350gitlab # [ 147.844240] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.009Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1351gitlab # [ 147.864608] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"753e829d887ea2e7f474cd8a","created_at":"2026-09-03T10:15:27.700Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"310d57006ce4b7abbf0b472adc537415","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.712Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-753e829d887ea2e7f474cd8a: done: 0.046256 sec","job_status":"done","queue_duration_s":0.270373,"scheduling_latency_s":0.2704,"redis_calls":10,"redis_duration_s":0.017049,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000928,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001954,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000267073,"duration_s":0.046256,"completed_at":"2026-09-03T10:15:28.028Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000834,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 147.867142] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4848939a243ba080e1002feb","created_at":"2026-09-03T10:15:27.722Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b327c1fc309f65c53870c02171bffd1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.733Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4848939a243ba080e1002feb: start","job_status":"start","queue_duration_s":0.297924,"scheduling_latency_s":0.297939}1353gitlab # [ 147.880404] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.046Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1354gitlab # [ 147.887217] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4848939a243ba080e1002feb","created_at":"2026-09-03T10:15:27.722Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b327c1fc309f65c53870c02171bffd1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.733Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4848939a243ba080e1002feb: done: 0.021649 sec","job_status":"done","queue_duration_s":0.297924,"scheduling_latency_s":0.297939,"redis_calls":10,"redis_duration_s":0.001347,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000244724,"duration_s":0.021649,"completed_at":"2026-09-03T10:15:28.052Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 147.946406] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b771eb8ba86cbf79fa6dbc3e","created_at":"2026-09-03T10:15:27.750Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a6b647cadbe32f0c7cf600341e74d0b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.842Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b771eb8ba86cbf79fa6dbc3e: start","job_status":"start","queue_duration_s":0.212221,"scheduling_latency_s":0.212236}1356gitlab # [ 147.947035] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.102Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b771eb8ba86cbf79fa6dbc3e","created_at":"2026-09-03T10:15:27.750Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a6b647cadbe32f0c7cf600341e74d0b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.842Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b771eb8ba86cbf79fa6dbc3e: done: 0.048239 sec","job_status":"done","queue_duration_s":0.212221,"scheduling_latency_s":0.212236,"redis_calls":19,"redis_duration_s":0.009057,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003559,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000187,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00472,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216788,"duration_s":0.048239,"completed_at":"2026-09-03T10:15:28.102Z","load_balancing_strategy":"primary","db_duration_s":0.010154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 147.970652] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"36824cbbb80917fcc6f7112c","created_at":"2026-09-03T10:15:27.857Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9abfbe91a1dea24d54518c93c534d7ff","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.869Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-36824cbbb80917fcc6f7112c: start","job_status":"start","queue_duration_s":0.241384,"scheduling_latency_s":0.241402}1358gitlab # [ 148.032430] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"36824cbbb80917fcc6f7112c","created_at":"2026-09-03T10:15:27.857Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9abfbe91a1dea24d54518c93c534d7ff","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.869Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-36824cbbb80917fcc6f7112c: done: 0.086919 sec","job_status":"done","queue_duration_s":0.241384,"scheduling_latency_s":0.241402,"redis_calls":10,"redis_duration_s":0.009048,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006701131,"duration_s":0.086919,"completed_at":"2026-09-03T10:15:28.197Z","load_balancing_strategy":"primary","db_duration_s":0.047359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 148.035318] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"15b5a48adec387576164d351","created_at":"2026-09-03T10:15:27.874Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2dc98b1be186e19761eae51e45f61046","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.890Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-15b5a48adec387576164d351: start","job_status":"start","queue_duration_s":0.310322,"scheduling_latency_s":0.310339}1360gitlab # [ 148.059373] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.224Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"15b5a48adec387576164d351","created_at":"2026-09-03T10:15:27.874Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2dc98b1be186e19761eae51e45f61046","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.890Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-15b5a48adec387576164d351: done: 0.023907 sec","job_status":"done","queue_duration_s":0.310322,"scheduling_latency_s":0.310339,"redis_calls":13,"redis_duration_s":0.001812,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005959417,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.023907,"completed_at":"2026-09-03T10:15:28.224Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001589,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1361gitlab # [ 148.083170] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a726d35cae1f43bffd62db80","created_at":"2026-09-03T10:15:27.901Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adc7826debef23eba5d4722f0176932a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:15:27.907Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a726d35cae1f43bffd62db80: start","job_status":"start","queue_duration_s":0.320038,"scheduling_latency_s":0.320053}1362gitlab # [ 148.095760] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a726d35cae1f43bffd62db80","created_at":"2026-09-03T10:15:27.901Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adc7826debef23eba5d4722f0176932a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:15:27.907Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a726d35cae1f43bffd62db80: done: 0.020419 sec","job_status":"done","queue_duration_s":0.320038,"scheduling_latency_s":0.320053,"redis_calls":10,"redis_duration_s":0.001392,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000215391,"duration_s":0.020419,"completed_at":"2026-09-03T10:15:28.248Z","load_balancing_strategy":"primary","db_duration_s":0.002234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 148.155860] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"252b47a55be19380aef1e9f2","created_at":"2026-09-03T10:15:27.918Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e419ed1f9f7519992fa5cce9193b68f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.927Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-252b47a55be19380aef1e9f2: start","job_status":"start","queue_duration_s":0.321534,"scheduling_latency_s":0.321547}1364gitlab # [ 148.318327] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"252b47a55be19380aef1e9f2","created_at":"2026-09-03T10:15:27.918Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e419ed1f9f7519992fa5cce9193b68f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.927Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-252b47a55be19380aef1e9f2: done: 0.234331 sec","job_status":"done","queue_duration_s":0.321534,"scheduling_latency_s":0.321547,"redis_calls":12,"redis_duration_s":0.002378,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001051,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000341104,"exclusive_lock_hold_duration_s":0.219606961,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.234331,"completed_at":"2026-09-03T10:15:28.483Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.131207,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 148.392805] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"dccb3f5f8fe5d3bdbe753cbd","created_at":"2026-09-03T10:15:27.936Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f048c0eb129b600d7be81616ed41848","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:15:27.945Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-dccb3f5f8fe5d3bdbe753cbd: start","job_status":"start","queue_duration_s":0.539573,"scheduling_latency_s":0.539589}1366gitlab # [ 148.405327] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.494Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1367gitlab # [ 148.408603] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"dccb3f5f8fe5d3bdbe753cbd","created_at":"2026-09-03T10:15:27.936Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f048c0eb129b600d7be81616ed41848","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:15:27.945Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-dccb3f5f8fe5d3bdbe753cbd: done: 0.014203 sec","job_status":"done","queue_duration_s":0.539573,"scheduling_latency_s":0.539589,"redis_calls":10,"redis_duration_s":0.002075,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000445,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001212,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000421562,"duration_s":0.014203,"completed_at":"2026-09-03T10:15:28.499Z","load_balancing_strategy":"primary","db_duration_s":0.000413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 148.447460] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.500Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"464a591572d8ebfe548a6d9e","created_at":"2026-09-03T10:15:27.959Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdd708af4e4e96ac80255f14faa7d532","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:15:27.966Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-464a591572d8ebfe548a6d9e: start","job_status":"start","queue_duration_s":0.533607,"scheduling_latency_s":0.53362}1369gitlab # [ 148.460193] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.508Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1370gitlab # [ 148.464484] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.513Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"464a591572d8ebfe548a6d9e","created_at":"2026-09-03T10:15:27.959Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdd708af4e4e96ac80255f14faa7d532","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:15:27.966Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-464a591572d8ebfe548a6d9e: done: 0.012881 sec","job_status":"done","queue_duration_s":0.533607,"scheduling_latency_s":0.53362,"redis_calls":10,"redis_duration_s":0.002088,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000447,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000268749,"duration_s":0.012881,"completed_at":"2026-09-03T10:15:28.513Z","load_balancing_strategy":"primary","db_duration_s":0.000268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 148.465856] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.514Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::StuckProjectImportJobsWorker","jid":"d66f96d2c1ca7118fb763937","created_at":"2026-09-03T10:15:27.976Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10695f899732f63051b0c440fa4593a8","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:65d1a1bda9b2a0115065de4f20868193e50a174305a7166fa20fbc82759e43e4","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.993Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::StuckProjectImportJobsWorker JID-d66f96d2c1ca7118fb763937: start","job_status":"start","queue_duration_s":0.520738,"scheduling_latency_s":0.520751}1372gitlab # [ 148.474304] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::StuckProjectImportJobsWorker","jid":"d66f96d2c1ca7118fb763937","created_at":"2026-09-03T10:15:27.976Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10695f899732f63051b0c440fa4593a8","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:65d1a1bda9b2a0115065de4f20868193e50a174305a7166fa20fbc82759e43e4","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:27.993Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::StuckProjectImportJobsWorker JID-d66f96d2c1ca7118fb763937: done: 0.018359 sec","job_status":"done","queue_duration_s":0.520738,"scheduling_latency_s":0.520751,"redis_calls":10,"redis_duration_s":0.001981,"redis_read_bytes":9,"redis_write_bytes":1173,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000415,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000385,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":236,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026847,"duration_s":0.018359,"completed_at":"2026-09-03T10:15:28.532Z","load_balancing_strategy":"primary","db_duration_s":0.002123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 148.524878] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"89b31ca93f2d44870d7b92b8","created_at":"2026-09-03T10:15:28.004Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3702ff558c0ffe2b0bfdadc567ea668","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.010Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-89b31ca93f2d44870d7b92b8: start","job_status":"start","queue_duration_s":0.523506,"scheduling_latency_s":0.523521}1374gitlab # [ 148.805801] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:28.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"89b31ca93f2d44870d7b92b8","created_at":"2026-09-03T10:15:28.004Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3702ff558c0ffe2b0bfdadc567ea668","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.010Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-89b31ca93f2d44870d7b92b8: done: 0.436926 sec","job_status":"done","queue_duration_s":0.523506,"scheduling_latency_s":0.523521,"redis_calls":565,"redis_duration_s":0.20685599999999998,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000403,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.205477,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.262427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219022,"duration_s":0.436926,"completed_at":"2026-09-03T10:15:28.971Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 148.886864] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.051Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"04d5ac598af3cac4bbb6ee56","created_at":"2026-09-03T10:15:28.017Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"357343518592a973d4aea97118bd883a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.025Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-04d5ac598af3cac4bbb6ee56: start","job_status":"start","queue_duration_s":1.026722,"scheduling_latency_s":1.026777}1376gitlab # [ 148.939857] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.104Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"04d5ac598af3cac4bbb6ee56","created_at":"2026-09-03T10:15:28.017Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"357343518592a973d4aea97118bd883a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.025Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-04d5ac598af3cac4bbb6ee56: done: 0.052975 sec","job_status":"done","queue_duration_s":1.026722,"scheduling_latency_s":1.026777,"redis_calls":10,"redis_duration_s":0.002845,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000534,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000636,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000584432,"duration_s":0.052975,"completed_at":"2026-09-03T10:15:29.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 148.996538] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.161Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"7c8bf3f444a44f336e5b9501","created_at":"2026-09-03T10:15:28.029Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfe3f03192a6f967ded447da2b65ec35","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.039Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-7c8bf3f444a44f336e5b9501: start","job_status":"start","queue_duration_s":1.122306,"scheduling_latency_s":1.122355}1378gitlab # [ 149.032361] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"7c8bf3f444a44f336e5b9501","created_at":"2026-09-03T10:15:28.029Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfe3f03192a6f967ded447da2b65ec35","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.039Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-7c8bf3f444a44f336e5b9501: done: 0.035537 sec","job_status":"done","queue_duration_s":1.122306,"scheduling_latency_s":1.122355,"redis_calls":11,"redis_duration_s":0.00381,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0007,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000521854,"duration_s":0.035537,"completed_at":"2026-09-03T10:15:29.196Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000834,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 149.073528] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"65fa8f7539128908788a03aa","created_at":"2026-09-03T10:15:28.044Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56e5bfcc5e0b477c5c1659f606269426","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.061Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-65fa8f7539128908788a03aa: start","job_status":"start","queue_duration_s":1.177106,"scheduling_latency_s":1.177154}1380gitlab # [ 149.093910] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.259Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1381gitlab # [ 149.107336] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"65fa8f7539128908788a03aa","created_at":"2026-09-03T10:15:28.044Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56e5bfcc5e0b477c5c1659f606269426","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.061Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-65fa8f7539128908788a03aa: done: 0.033865 sec","job_status":"done","queue_duration_s":1.177106,"scheduling_latency_s":1.177154,"redis_calls":10,"redis_duration_s":0.003357,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000621,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002036,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0007,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000515988,"duration_s":0.033865,"completed_at":"2026-09-03T10:15:29.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 149.110172] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.275Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8c33332284e903ec8b823953","created_at":"2026-09-03T10:15:28.066Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f79d8c1d331708a29638c8c1e600ebc4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.074Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8c33332284e903ec8b823953: start","job_status":"start","queue_duration_s":1.20085,"scheduling_latency_s":1.200887}1383gitlab # [ 149.193166] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.357Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8c33332284e903ec8b823953","created_at":"2026-09-03T10:15:28.066Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f79d8c1d331708a29638c8c1e600ebc4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.074Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8c33332284e903ec8b823953: done: 0.082169 sec","job_status":"done","queue_duration_s":1.20085,"scheduling_latency_s":1.200887,"redis_calls":12,"redis_duration_s":0.003027,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001002,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001502,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000419327,"duration_s":0.082169,"completed_at":"2026-09-03T10:15:29.357Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 149.196887] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"02bf12f2b6ba79c98e5da0d0","created_at":"2026-09-03T10:15:28.076Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"beb257c3a8c074839f83b85d41936b01","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.084Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-02bf12f2b6ba79c98e5da0d0: start","job_status":"start","queue_duration_s":1.277213,"scheduling_latency_s":1.277248}1385gitlab # [ 149.222645] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"02bf12f2b6ba79c98e5da0d0","created_at":"2026-09-03T10:15:28.076Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"beb257c3a8c074839f83b85d41936b01","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.084Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-02bf12f2b6ba79c98e5da0d0: done: 0.02598 sec","job_status":"done","queue_duration_s":1.277213,"scheduling_latency_s":1.277248,"redis_calls":12,"redis_duration_s":0.0024460000000000003,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000339708,"exclusive_lock_hold_duration_s":0.004968789,"duration_s":0.02598,"completed_at":"2026-09-03T10:15:29.388Z","load_balancing_strategy":"primary","db_duration_s":0.003052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 149.243269] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.389Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fa95a2b5d1089540fcbe887a","created_at":"2026-09-03T10:15:28.072Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-ddc0e077a6184eae","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a6b647cadbe32f0c7cf600341e74d0b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.089Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fa95a2b5d1089540fcbe887a: start","job_status":"start","queue_duration_s":1.299567,"scheduling_latency_s":1.299582}1387gitlab # [ 149.289871] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.455Z","message":"No existing merge request to be cleaned up."}1388gitlab # [ 149.309054] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.474Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fa95a2b5d1089540fcbe887a","created_at":"2026-09-03T10:15:28.072Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-ddc0e077a6184eae","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a6b647cadbe32f0c7cf600341e74d0b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.089Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fa95a2b5d1089540fcbe887a: done: 0.084957 sec","job_status":"done","queue_duration_s":1.299567,"scheduling_latency_s":1.299582,"redis_calls":13,"redis_duration_s":0.002883,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000295,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001341,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000565155,"duration_s":0.084957,"completed_at":"2026-09-03T10:15:29.474Z","load_balancing_strategy":"primary","db_duration_s":0.002898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 149.311151] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.476Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df4d0200698676d70893b7cb","created_at":"2026-09-03T10:15:28.072Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-ddc0e077a6184eae","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a6b647cadbe32f0c7cf600341e74d0b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.089Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df4d0200698676d70893b7cb: start","job_status":"start","queue_duration_s":1.386996,"scheduling_latency_s":1.387028}1390gitlab # [ 149.325812] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.491Z","message":"No existing merge request to be cleaned up."}1391gitlab # [ 149.336523] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.501Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df4d0200698676d70893b7cb","created_at":"2026-09-03T10:15:28.072Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-ddc0e077a6184eae","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a6b647cadbe32f0c7cf600341e74d0b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.089Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df4d0200698676d70893b7cb: done: 0.024841 sec","job_status":"done","queue_duration_s":1.386996,"scheduling_latency_s":1.387028,"redis_calls":10,"redis_duration_s":0.002531,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001597,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024841,"completed_at":"2026-09-03T10:15:29.501Z","load_balancing_strategy":"primary","db_duration_s":0.001818,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 149.377857] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.505Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"de812e71bdcb1287130fff5c","created_at":"2026-09-03T10:15:28.072Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-ddc0e077a6184eae","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a6b647cadbe32f0c7cf600341e74d0b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.089Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-de812e71bdcb1287130fff5c: start","job_status":"start","queue_duration_s":1.415487,"scheduling_latency_s":1.415513}1393gitlab # [ 149.378811] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.516Z","message":"No existing merge request to be cleaned up."}1394gitlab # [ 149.379592] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.524Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"de812e71bdcb1287130fff5c","created_at":"2026-09-03T10:15:28.072Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-ddc0e077a6184eae","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a6b647cadbe32f0c7cf600341e74d0b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.089Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-de812e71bdcb1287130fff5c: done: 0.019105 sec","job_status":"done","queue_duration_s":1.415487,"scheduling_latency_s":1.415513,"redis_calls":10,"redis_duration_s":0.00182,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019105,"completed_at":"2026-09-03T10:15:29.524Z","load_balancing_strategy":"primary","db_duration_s":0.0014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 149.429853] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.525Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4680020615f9204457bde353","created_at":"2026-09-03T10:15:28.072Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-ddc0e077a6184eae","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a6b647cadbe32f0c7cf600341e74d0b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.089Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4680020615f9204457bde353: start","job_status":"start","queue_duration_s":1.435446,"scheduling_latency_s":1.43546}1396gitlab # [ 149.430769] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.531Z","message":"No existing merge request to be cleaned up."}1397gitlab # [ 149.431304] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.536Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4680020615f9204457bde353","created_at":"2026-09-03T10:15:28.072Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-ddc0e077a6184eae","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5a6b647cadbe32f0c7cf600341e74d0b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.089Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4680020615f9204457bde353: done: 0.011232 sec","job_status":"done","queue_duration_s":1.435446,"scheduling_latency_s":1.43546,"redis_calls":10,"redis_duration_s":0.001253,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000752,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011232,"completed_at":"2026-09-03T10:15:29.536Z","load_balancing_strategy":"primary","db_duration_s":0.000965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 149.446807] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6577aaa7196945740e351b9d","created_at":"2026-09-03T10:15:28.086Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.096Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6577aaa7196945740e351b9d: start","job_status":"start","queue_duration_s":1.440681,"scheduling_latency_s":1.440695}1399gitlab # [ 149.496716] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6577aaa7196945740e351b9d","created_at":"2026-09-03T10:15:28.086Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.096Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6577aaa7196945740e351b9d: done: 0.124427 sec","job_status":"done","queue_duration_s":1.440681,"scheduling_latency_s":1.440695,"redis_calls":71,"redis_duration_s":0.015726,"redis_read_bytes":120,"redis_write_bytes":42574,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00617,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000611,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.00836,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000240254,"duration_s":0.124427,"completed_at":"2026-09-03T10:15:29.661Z","load_balancing_strategy":"primary","db_duration_s":0.004436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 149.498968] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.664Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0ab8b0334e4df5f7b3084fd5","created_at":"2026-09-03T10:15:28.101Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b09a6a073e6d20b22cf13c21b7c46cc","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.106Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0ab8b0334e4df5f7b3084fd5: start","job_status":"start","queue_duration_s":1.558234,"scheduling_latency_s":1.55825}1401gitlab # [ 149.545747] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.691Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0ab8b0334e4df5f7b3084fd5","created_at":"2026-09-03T10:15:28.101Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b09a6a073e6d20b22cf13c21b7c46cc","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.106Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0ab8b0334e4df5f7b3084fd5: done: 0.027051 sec","job_status":"done","queue_duration_s":1.558234,"scheduling_latency_s":1.55825,"redis_calls":10,"redis_duration_s":0.002022,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210083,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.027051,"completed_at":"2026-09-03T10:15:29.691Z","load_balancing_strategy":"primary","db_duration_s":0.007899,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 149.550588] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"22cdfbcca6b5459dd5bd7940","created_at":"2026-09-03T10:15:28.110Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8e5167ab5507cc2342a5b3048e97ef5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.121Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-22cdfbcca6b5459dd5bd7940: start","job_status":"start","queue_duration_s":1.571333,"scheduling_latency_s":1.571354}1403gitlab # [ 149.593256] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"22cdfbcca6b5459dd5bd7940","created_at":"2026-09-03T10:15:28.110Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8e5167ab5507cc2342a5b3048e97ef5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.121Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-22cdfbcca6b5459dd5bd7940: done: 0.012148 sec","job_status":"done","queue_duration_s":1.571333,"scheduling_latency_s":1.571354,"redis_calls":10,"redis_duration_s":0.001163,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208407,"duration_s":0.012148,"completed_at":"2026-09-03T10:15:29.704Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 149.601651] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.705Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMigrateExternalDiffsWorker","jid":"2039463949170591be429294","created_at":"2026-09-03T10:15:28.123Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6943ccaa74fa6382e34775a51c33fd09","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1f56d9ee4ddd7fd390ae51dd41358b9c806acf2491cad4e28b1956ebf69a9b52","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.133Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMigrateExternalDiffsWorker JID-2039463949170591be429294: start","job_status":"start","queue_duration_s":1.572159,"scheduling_latency_s":1.572172}1405gitlab # [ 149.643906] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMigrateExternalDiffsWorker","jid":"2039463949170591be429294","created_at":"2026-09-03T10:15:28.123Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6943ccaa74fa6382e34775a51c33fd09","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1f56d9ee4ddd7fd390ae51dd41358b9c806acf2491cad4e28b1956ebf69a9b52","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.133Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMigrateExternalDiffsWorker JID-2039463949170591be429294: done: 0.016198 sec","job_status":"done","queue_duration_s":1.572159,"scheduling_latency_s":1.572172,"redis_calls":12,"redis_duration_s":0.003397,"redis_read_bytes":11,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000617,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":311,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001526,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001254,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":533,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000323784,"exclusive_lock_hold_duration_s":0.000423517,"duration_s":0.016198,"completed_at":"2026-09-03T10:15:29.721Z","load_balancing_strategy":"primary","db_duration_s":0.003426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 149.652537] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"fc961d7d5dc0c4c67854eb61","created_at":"2026-09-03T10:15:28.150Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"843a9aeea7dd0895c8b549c196e5dd88","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.156Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-fc961d7d5dc0c4c67854eb61: start","job_status":"start","queue_duration_s":1.566119,"scheduling_latency_s":1.566133}1407gitlab # [ 149.665185] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"fc961d7d5dc0c4c67854eb61","created_at":"2026-09-03T10:15:28.150Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"843a9aeea7dd0895c8b549c196e5dd88","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.156Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-fc961d7d5dc0c4c67854eb61: done: 0.013578 sec","job_status":"done","queue_duration_s":1.566119,"scheduling_latency_s":1.566133,"redis_calls":12,"redis_duration_s":0.001479,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000280203,"exclusive_lock_hold_duration_s":0.0020295870000000002,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.013578,"completed_at":"2026-09-03T10:15:29.736Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000959,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 149.732060] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"166470766a0408ca825599eb","created_at":"2026-09-03T10:15:28.160Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"326d91e5d2660a27b1ee9ff0cb0f85f4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.163Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-166470766a0408ca825599eb: start","job_status":"start","queue_duration_s":1.573522,"scheduling_latency_s":1.573535}1409gitlab # [ 149.732770] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.743Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1410gitlab # [ 149.733428] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.747Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"166470766a0408ca825599eb","created_at":"2026-09-03T10:15:28.160Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"326d91e5d2660a27b1ee9ff0cb0f85f4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.163Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-166470766a0408ca825599eb: done: 0.010942 sec","job_status":"done","queue_duration_s":1.573522,"scheduling_latency_s":1.573535,"redis_calls":10,"redis_duration_s":0.001208,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000224,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196673,"duration_s":0.010942,"completed_at":"2026-09-03T10:15:29.747Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 149.775023] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"dc50eb519fb17fdfe678c8e0","created_at":"2026-09-03T10:15:28.168Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a772bb37fb90095ef26487b68a7e213d","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.172Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-dc50eb519fb17fdfe678c8e0: start","job_status":"start","queue_duration_s":1.576042,"scheduling_latency_s":1.576055}1412gitlab # [ 149.775804] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.767Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"dc50eb519fb17fdfe678c8e0","created_at":"2026-09-03T10:15:28.168Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a772bb37fb90095ef26487b68a7e213d","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.172Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-dc50eb519fb17fdfe678c8e0: done: 0.01903 sec","job_status":"done","queue_duration_s":1.576042,"scheduling_latency_s":1.576055,"redis_calls":10,"redis_duration_s":0.001253,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00023,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204775,"duration_s":0.01903,"completed_at":"2026-09-03T10:15:29.767Z","load_balancing_strategy":"primary","db_duration_s":0.004415,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 149.820771] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.768Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0c41243b422d272234dddf2a","created_at":"2026-09-03T10:15:28.179Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6a92e5b0f1ba6cd78577a2cb04f8b57","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.185Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0c41243b422d272234dddf2a: start","job_status":"start","queue_duration_s":1.582783,"scheduling_latency_s":1.582796}1414gitlab # [ 149.823947] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.783Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0c41243b422d272234dddf2a","created_at":"2026-09-03T10:15:28.179Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6a92e5b0f1ba6cd78577a2cb04f8b57","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.185Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0c41243b422d272234dddf2a: done: 0.014494 sec","job_status":"done","queue_duration_s":1.582783,"scheduling_latency_s":1.582796,"redis_calls":10,"redis_duration_s":0.0014060000000000001,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000193041,"duration_s":0.014494,"completed_at":"2026-09-03T10:15:29.783Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 149.867222] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.783Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"9b5e0baad8b816ffb658a9c9","created_at":"2026-09-03T10:15:28.191Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f48028ebe679335650a7e0424d48f897","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.200Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-9b5e0baad8b816ffb658a9c9: start","job_status":"start","queue_duration_s":1.58344,"scheduling_latency_s":1.583453}1416gitlab # [ 149.909200] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"9b5e0baad8b816ffb658a9c9","created_at":"2026-09-03T10:15:28.191Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f48028ebe679335650a7e0424d48f897","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:28.200Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-9b5e0baad8b816ffb658a9c9: done: 0.014928 sec","job_status":"done","queue_duration_s":1.58344,"scheduling_latency_s":1.583453,"redis_calls":11,"redis_duration_s":0.001313,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000232,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000354,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000193042,"duration_s":0.014928,"completed_at":"2026-09-03T10:15:29.798Z","load_balancing_strategy":"primary","db_duration_s":0.001626,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 149.911870] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b554c38eecaca3dffb888c3","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b554c38eecaca3dffb888c3: start","job_status":"start","queue_duration_s":0.144159,"scheduling_latency_s":0.144172}1418gitlab # [ 149.957768] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b554c38eecaca3dffb888c3","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b554c38eecaca3dffb888c3: done: 0.018709 sec","job_status":"done","queue_duration_s":0.144159,"scheduling_latency_s":0.144172,"redis_calls":16,"redis_duration_s":0.007192,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004402,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002548,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001018844,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018709,"completed_at":"2026-09-03T10:15:29.818Z","load_balancing_strategy":"primary","db_duration_s":0.000257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 149.960596] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0296487a9817674010d1bd5","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0296487a9817674010d1bd5: start","job_status":"start","queue_duration_s":0.168146,"scheduling_latency_s":0.168161}1420gitlab # [ 149.972868] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0296487a9817674010d1bd5","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0296487a9817674010d1bd5: done: 0.019435 sec","job_status":"done","queue_duration_s":0.168146,"scheduling_latency_s":0.168161,"redis_calls":13,"redis_duration_s":0.010272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002723,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007549,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019435,"completed_at":"2026-09-03T10:15:29.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 150.014408] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e104a7d6448ead5f2897c81","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e104a7d6448ead5f2897c81: start","job_status":"start","queue_duration_s":0.190174,"scheduling_latency_s":0.190189}1422gitlab # [ 150.054721] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e104a7d6448ead5f2897c81","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e104a7d6448ead5f2897c81: done: 0.015753 sec","job_status":"done","queue_duration_s":0.190174,"scheduling_latency_s":0.190189,"redis_calls":13,"redis_duration_s":0.006772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015753,"completed_at":"2026-09-03T10:15:29.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 150.055748] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72ec90f47f68be4207b27215","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72ec90f47f68be4207b27215: start","job_status":"start","queue_duration_s":0.206785,"scheduling_latency_s":0.206798}1424gitlab # [ 150.096608] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72ec90f47f68be4207b27215","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72ec90f47f68be4207b27215: done: 0.009068 sec","job_status":"done","queue_duration_s":0.206785,"scheduling_latency_s":0.206798,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000452,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009068,"completed_at":"2026-09-03T10:15:29.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 150.101715] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba4dfd812af013f7e23da023","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba4dfd812af013f7e23da023: start","job_status":"start","queue_duration_s":0.216631,"scheduling_latency_s":0.216654}1426gitlab # [ 150.113543] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba4dfd812af013f7e23da023","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba4dfd812af013f7e23da023: done: 0.009267 sec","job_status":"done","queue_duration_s":0.216631,"scheduling_latency_s":0.216654,"redis_calls":13,"redis_duration_s":0.00137,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009267,"completed_at":"2026-09-03T10:15:29.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 150.180662] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"163599cfe409860baf33ebea","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-163599cfe409860baf33ebea: start","job_status":"start","queue_duration_s":0.226757,"scheduling_latency_s":0.22677}1428gitlab # [ 150.184055] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"163599cfe409860baf33ebea","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-163599cfe409860baf33ebea: done: 0.009001 sec","job_status":"done","queue_duration_s":0.226757,"scheduling_latency_s":0.22677,"redis_calls":13,"redis_duration_s":0.001391,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009001,"completed_at":"2026-09-03T10:15:29.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 150.196220] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b58c01e05a4542273cc4e43","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b58c01e05a4542273cc4e43: start","job_status":"start","queue_duration_s":0.236612,"scheduling_latency_s":0.236625}1430gitlab # [ 150.207150] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b58c01e05a4542273cc4e43","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b58c01e05a4542273cc4e43: done: 0.012827 sec","job_status":"done","queue_duration_s":0.236612,"scheduling_latency_s":0.236625,"redis_calls":13,"redis_duration_s":0.0050539999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004606,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012827,"completed_at":"2026-09-03T10:15:29.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 150.260573] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ce1598169bd04ffd207fd82","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ce1598169bd04ffd207fd82: start","job_status":"start","queue_duration_s":0.250257,"scheduling_latency_s":0.250272}1432gitlab # [ 150.261435] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ce1598169bd04ffd207fd82","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ce1598169bd04ffd207fd82: done: 0.009315 sec","job_status":"done","queue_duration_s":0.250257,"scheduling_latency_s":0.250272,"redis_calls":13,"redis_duration_s":0.0013830000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009315,"completed_at":"2026-09-03T10:15:29.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 150.303747] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d60fc44805deed66ccfd779","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d60fc44805deed66ccfd779: start","job_status":"start","queue_duration_s":0.260913,"scheduling_latency_s":0.260927}1434gitlab # [ 150.304610] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d60fc44805deed66ccfd779","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d60fc44805deed66ccfd779: done: 0.009295 sec","job_status":"done","queue_duration_s":0.260913,"scheduling_latency_s":0.260927,"redis_calls":13,"redis_duration_s":0.001376,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009295,"completed_at":"2026-09-03T10:15:29.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 150.351690] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1077a0c1c673d234c3c685","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1077a0c1c673d234c3c685: start","job_status":"start","queue_duration_s":0.270995,"scheduling_latency_s":0.271008}1436gitlab # [ 150.352572] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1077a0c1c673d234c3c685","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1077a0c1c673d234c3c685: done: 0.009356 sec","job_status":"done","queue_duration_s":0.270995,"scheduling_latency_s":0.271008,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009356,"completed_at":"2026-09-03T10:15:29.936Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 150.375692] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c1e90bc8fdca20a18eef025","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c1e90bc8fdca20a18eef025: start","job_status":"start","queue_duration_s":0.281153,"scheduling_latency_s":0.281167}1438gitlab # [ 150.419675] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c1e90bc8fdca20a18eef025","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c1e90bc8fdca20a18eef025: done: 0.017928 sec","job_status":"done","queue_duration_s":0.281153,"scheduling_latency_s":0.281167,"redis_calls":13,"redis_duration_s":0.00979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002297,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007493,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017928,"completed_at":"2026-09-03T10:15:29.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 150.422227] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72e975831801ac77ac6eb6ed","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72e975831801ac77ac6eb6ed: start","job_status":"start","queue_duration_s":0.2999,"scheduling_latency_s":0.299913}1440gitlab # [ 150.433693] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72e975831801ac77ac6eb6ed","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72e975831801ac77ac6eb6ed: done: 0.00969 sec","job_status":"done","queue_duration_s":0.2999,"scheduling_latency_s":0.299913,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000454,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00969,"completed_at":"2026-09-03T10:15:29.965Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 150.498062] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ca9d3fb4269cad3eaa31e6c","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ca9d3fb4269cad3eaa31e6c: start","job_status":"start","queue_duration_s":0.310399,"scheduling_latency_s":0.310411}1442gitlab # [ 150.498818] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ca9d3fb4269cad3eaa31e6c","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ca9d3fb4269cad3eaa31e6c: done: 0.009137 sec","job_status":"done","queue_duration_s":0.310399,"scheduling_latency_s":0.310411,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009137,"completed_at":"2026-09-03T10:15:29.975Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 150.553711] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5896a0f3cac62ccb78e3508e","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5896a0f3cac62ccb78e3508e: start","job_status":"start","queue_duration_s":0.320337,"scheduling_latency_s":0.32035}1444gitlab # [ 150.554564] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5896a0f3cac62ccb78e3508e","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5896a0f3cac62ccb78e3508e: done: 0.012395 sec","job_status":"done","queue_duration_s":0.320337,"scheduling_latency_s":0.32035,"redis_calls":13,"redis_duration_s":0.001594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012395,"completed_at":"2026-09-03T10:15:29.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 150.561725] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:29.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"650d9d9563baeed389dc5613","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-650d9d9563baeed389dc5613: start","job_status":"start","queue_duration_s":0.337233,"scheduling_latency_s":0.337257}1446gitlab # [ 150.600226] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"650d9d9563baeed389dc5613","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-650d9d9563baeed389dc5613: done: 0.010416 sec","job_status":"done","queue_duration_s":0.337233,"scheduling_latency_s":0.337257,"redis_calls":13,"redis_duration_s":0.0016059999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010416,"completed_at":"2026-09-03T10:15:30.003Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 150.605978] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9c4c9f44077f0d99dbaae26","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9c4c9f44077f0d99dbaae26: start","job_status":"start","queue_duration_s":0.348447,"scheduling_latency_s":0.34846}1448gitlab # [ 150.616987] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9c4c9f44077f0d99dbaae26","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9c4c9f44077f0d99dbaae26: done: 0.009292 sec","job_status":"done","queue_duration_s":0.348447,"scheduling_latency_s":0.34846,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009292,"completed_at":"2026-09-03T10:15:30.013Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 150.659749] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4e3aa3ebad489a332be5a28","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4e3aa3ebad489a332be5a28: start","job_status":"start","queue_duration_s":0.358563,"scheduling_latency_s":0.358577}1450gitlab # [ 150.661094] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4e3aa3ebad489a332be5a28","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4e3aa3ebad489a332be5a28: done: 0.009063 sec","job_status":"done","queue_duration_s":0.358563,"scheduling_latency_s":0.358577,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009063,"completed_at":"2026-09-03T10:15:30.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 150.695920] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c4b4eb72e9be010c30a556d","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c4b4eb72e9be010c30a556d: start","job_status":"start","queue_duration_s":0.368475,"scheduling_latency_s":0.368488}1452gitlab # [ 150.739446] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c4b4eb72e9be010c30a556d","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c4b4eb72e9be010c30a556d: done: 0.012337 sec","job_status":"done","queue_duration_s":0.368475,"scheduling_latency_s":0.368488,"redis_calls":13,"redis_duration_s":0.004631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012337,"completed_at":"2026-09-03T10:15:30.036Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 150.740618] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73f8ddbacca91bd20812cbd5","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73f8ddbacca91bd20812cbd5: start","job_status":"start","queue_duration_s":0.381717,"scheduling_latency_s":0.38173}1454gitlab # [ 150.751068] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73f8ddbacca91bd20812cbd5","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73f8ddbacca91bd20812cbd5: done: 0.009168 sec","job_status":"done","queue_duration_s":0.381717,"scheduling_latency_s":0.38173,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009168,"completed_at":"2026-09-03T10:15:30.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 150.819763] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff7cd9a93941670b1bdfc9e6","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff7cd9a93941670b1bdfc9e6: start","job_status":"start","queue_duration_s":0.391761,"scheduling_latency_s":0.391773}1456gitlab # [ 150.820630] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff7cd9a93941670b1bdfc9e6","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff7cd9a93941670b1bdfc9e6: done: 0.009185 sec","job_status":"done","queue_duration_s":0.391761,"scheduling_latency_s":0.391773,"redis_calls":13,"redis_duration_s":0.0015509999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009185,"completed_at":"2026-09-03T10:15:30.056Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 150.866573] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d51417c44a86f527f26f4070","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d51417c44a86f527f26f4070: start","job_status":"start","queue_duration_s":0.402118,"scheduling_latency_s":0.402132}1458gitlab # [ 150.867431] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d51417c44a86f527f26f4070","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d51417c44a86f527f26f4070: done: 0.00954 sec","job_status":"done","queue_duration_s":0.402118,"scheduling_latency_s":0.402132,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00954,"completed_at":"2026-09-03T10:15:30.067Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 150.905917] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c421efa3e78b5c00c32b6192","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c421efa3e78b5c00c32b6192: start","job_status":"start","queue_duration_s":0.412561,"scheduling_latency_s":0.412575}1460gitlab # [ 150.906616] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c421efa3e78b5c00c32b6192","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c421efa3e78b5c00c32b6192: done: 0.011842 sec","job_status":"done","queue_duration_s":0.412561,"scheduling_latency_s":0.412575,"redis_calls":13,"redis_duration_s":0.0038650000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002288,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011842,"completed_at":"2026-09-03T10:15:30.080Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 150.918928] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71975103b27b72bf98e5eb68","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71975103b27b72bf98e5eb68: start","job_status":"start","queue_duration_s":0.427301,"scheduling_latency_s":0.427316}1462gitlab # [ 150.929865] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71975103b27b72bf98e5eb68","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71975103b27b72bf98e5eb68: done: 0.009188 sec","job_status":"done","queue_duration_s":0.427301,"scheduling_latency_s":0.427316,"redis_calls":13,"redis_duration_s":0.001515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009188,"completed_at":"2026-09-03T10:15:30.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 150.975756] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ddd87eb2b2e05c5dc254f22","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ddd87eb2b2e05c5dc254f22: start","job_status":"start","queue_duration_s":0.437333,"scheduling_latency_s":0.437346}1464gitlab # [ 150.976641] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ddd87eb2b2e05c5dc254f22","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ddd87eb2b2e05c5dc254f22: done: 0.00989 sec","job_status":"done","queue_duration_s":0.437333,"scheduling_latency_s":0.437346,"redis_calls":13,"redis_duration_s":0.002314,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001428,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00989,"completed_at":"2026-09-03T10:15:30.103Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 151.008745] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce76108a5c266f2e979b4d13","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce76108a5c266f2e979b4d13: start","job_status":"start","queue_duration_s":0.448241,"scheduling_latency_s":0.448254}1466gitlab # [ 151.056681] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce76108a5c266f2e979b4d13","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce76108a5c266f2e979b4d13: done: 0.008815 sec","job_status":"done","queue_duration_s":0.448241,"scheduling_latency_s":0.448254,"redis_calls":13,"redis_duration_s":0.001394,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000447,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008815,"completed_at":"2026-09-03T10:15:30.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 151.057660] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80d874de139e4cd97b3bfe2b","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80d874de139e4cd97b3bfe2b: start","job_status":"start","queue_duration_s":0.457871,"scheduling_latency_s":0.457883}1468gitlab # [ 151.102548] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80d874de139e4cd97b3bfe2b","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80d874de139e4cd97b3bfe2b: done: 0.008787 sec","job_status":"done","queue_duration_s":0.457871,"scheduling_latency_s":0.457883,"redis_calls":13,"redis_duration_s":0.001388,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000446,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008787,"completed_at":"2026-09-03T10:15:30.122Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 151.103601] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90ebfd1927272ffe3c9d1d7d","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90ebfd1927272ffe3c9d1d7d: start","job_status":"start","queue_duration_s":0.470589,"scheduling_latency_s":0.470603}1470gitlab # [ 151.111663] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90ebfd1927272ffe3c9d1d7d","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90ebfd1927272ffe3c9d1d7d: done: 0.016557 sec","job_status":"done","queue_duration_s":0.470589,"scheduling_latency_s":0.470603,"redis_calls":13,"redis_duration_s":0.007887,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006336,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016557,"completed_at":"2026-09-03T10:15:30.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 151.148436] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54b62dc2ca3eeb70092dab61","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54b62dc2ca3eeb70092dab61: start","job_status":"start","queue_duration_s":0.487977,"scheduling_latency_s":0.48799}1472gitlab # [ 151.160133] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54b62dc2ca3eeb70092dab61","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54b62dc2ca3eeb70092dab61: done: 0.009124 sec","job_status":"done","queue_duration_s":0.487977,"scheduling_latency_s":0.48799,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000446,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009124,"completed_at":"2026-09-03T10:15:30.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 151.224152] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9849994444816db5c2b38a24","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9849994444816db5c2b38a24: start","job_status":"start","queue_duration_s":0.497981,"scheduling_latency_s":0.497994}1474gitlab # [ 151.224495] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9849994444816db5c2b38a24","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9849994444816db5c2b38a24: done: 0.008787 sec","job_status":"done","queue_duration_s":0.497981,"scheduling_latency_s":0.497994,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000453,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008787,"completed_at":"2026-09-03T10:15:30.162Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 151.264630] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"274017719ded8bd109071add","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-274017719ded8bd109071add: start","job_status":"start","queue_duration_s":0.507584,"scheduling_latency_s":0.507599}1476gitlab # [ 151.265262] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"274017719ded8bd109071add","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-274017719ded8bd109071add: done: 0.008821 sec","job_status":"done","queue_duration_s":0.507584,"scheduling_latency_s":0.507599,"redis_calls":13,"redis_duration_s":0.001387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000441,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008821,"completed_at":"2026-09-03T10:15:30.172Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 151.306242] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09aa1259cc68bcf454ec971d","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09aa1259cc68bcf454ec971d: start","job_status":"start","queue_duration_s":0.51729,"scheduling_latency_s":0.517304}1478gitlab # [ 151.307057] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09aa1259cc68bcf454ec971d","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09aa1259cc68bcf454ec971d: done: 0.009455 sec","job_status":"done","queue_duration_s":0.51729,"scheduling_latency_s":0.517304,"redis_calls":13,"redis_duration_s":0.002021,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001388,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009455,"completed_at":"2026-09-03T10:15:30.182Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 151.346658] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6119716fccc5d5dcfe69e24f","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6119716fccc5d5dcfe69e24f: start","job_status":"start","queue_duration_s":0.527752,"scheduling_latency_s":0.527765}1480gitlab # [ 151.347259] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6119716fccc5d5dcfe69e24f","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6119716fccc5d5dcfe69e24f: done: 0.008925 sec","job_status":"done","queue_duration_s":0.527752,"scheduling_latency_s":0.527765,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000444,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008925,"completed_at":"2026-09-03T10:15:30.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 151.385995] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d49a5742adf358253843d6e","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d49a5742adf358253843d6e: start","job_status":"start","queue_duration_s":0.537533,"scheduling_latency_s":0.537547}1482gitlab # [ 151.390983] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d49a5742adf358253843d6e","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d49a5742adf358253843d6e: done: 0.0092 sec","job_status":"done","queue_duration_s":0.537533,"scheduling_latency_s":0.537547,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0092,"completed_at":"2026-09-03T10:15:30.202Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 151.449267] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8a16e1d94849e2891d07d8b","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8a16e1d94849e2891d07d8b: start","job_status":"start","queue_duration_s":0.547558,"scheduling_latency_s":0.547571}1484gitlab # [ 151.450041] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8a16e1d94849e2891d07d8b","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8a16e1d94849e2891d07d8b: done: 0.00917 sec","job_status":"done","queue_duration_s":0.547558,"scheduling_latency_s":0.547571,"redis_calls":13,"redis_duration_s":0.0014039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000451,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00917,"completed_at":"2026-09-03T10:15:30.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 151.491309] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f08e1fad9e9d81dbac1f33b3","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f08e1fad9e9d81dbac1f33b3: start","job_status":"start","queue_duration_s":0.557594,"scheduling_latency_s":0.557606}1486gitlab # [ 151.492094] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f08e1fad9e9d81dbac1f33b3","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f08e1fad9e9d81dbac1f33b3: done: 0.012164 sec","job_status":"done","queue_duration_s":0.557594,"scheduling_latency_s":0.557606,"redis_calls":13,"redis_duration_s":0.004246,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003291,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012164,"completed_at":"2026-09-03T10:15:30.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 151.549599] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed22cf501da06ebf08a5e44","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed22cf501da06ebf08a5e44: start","job_status":"start","queue_duration_s":0.570738,"scheduling_latency_s":0.570751}1488gitlab # [ 151.550542] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed22cf501da06ebf08a5e44","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed22cf501da06ebf08a5e44: done: 0.009264 sec","job_status":"done","queue_duration_s":0.570738,"scheduling_latency_s":0.570751,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009264,"completed_at":"2026-09-03T10:15:30.235Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 151.566103] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53b4107d7f10c6158f261fa6","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53b4107d7f10c6158f261fa6: start","job_status":"start","queue_duration_s":0.580919,"scheduling_latency_s":0.580932}1490gitlab # [ 151.577803] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53b4107d7f10c6158f261fa6","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53b4107d7f10c6158f261fa6: done: 0.009243 sec","job_status":"done","queue_duration_s":0.580919,"scheduling_latency_s":0.580932,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009243,"completed_at":"2026-09-03T10:15:30.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 151.619140] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ea19d26a7b7b9fdf4b16301","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ea19d26a7b7b9fdf4b16301: start","job_status":"start","queue_duration_s":0.591075,"scheduling_latency_s":0.591089}1492gitlab # [ 151.624501] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ea19d26a7b7b9fdf4b16301","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ea19d26a7b7b9fdf4b16301: done: 0.009277 sec","job_status":"done","queue_duration_s":0.591075,"scheduling_latency_s":0.591089,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009277,"completed_at":"2026-09-03T10:15:30.256Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 151.692743] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bba4560908e7b07c17b67f3","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bba4560908e7b07c17b67f3: start","job_status":"start","queue_duration_s":0.601168,"scheduling_latency_s":0.601182}1494gitlab # [ 151.693627] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bba4560908e7b07c17b67f3","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bba4560908e7b07c17b67f3: done: 0.017573 sec","job_status":"done","queue_duration_s":0.601168,"scheduling_latency_s":0.601182,"redis_calls":13,"redis_duration_s":0.008490000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001209,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007281,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017573,"completed_at":"2026-09-03T10:15:30.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 151.708082] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caa8428f35e3ad066af80e40","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caa8428f35e3ad066af80e40: start","job_status":"start","queue_duration_s":0.622271,"scheduling_latency_s":0.622286}1496gitlab # [ 151.719763] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caa8428f35e3ad066af80e40","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caa8428f35e3ad066af80e40: done: 0.019517 sec","job_status":"done","queue_duration_s":0.622271,"scheduling_latency_s":0.622286,"redis_calls":13,"redis_duration_s":0.010091000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019517,"completed_at":"2026-09-03T10:15:30.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 151.756875] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24f6f580c0535fbeea18d5f1","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24f6f580c0535fbeea18d5f1: start","job_status":"start","queue_duration_s":0.644207,"scheduling_latency_s":0.644222}1498gitlab # [ 151.800773] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24f6f580c0535fbeea18d5f1","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24f6f580c0535fbeea18d5f1: done: 0.012337 sec","job_status":"done","queue_duration_s":0.644207,"scheduling_latency_s":0.644222,"redis_calls":13,"redis_duration_s":0.002888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001305,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001583,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012337,"completed_at":"2026-09-03T10:15:30.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 151.803420] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c796d0d94832f85a4ea69779","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c796d0d94832f85a4ea69779: start","job_status":"start","queue_duration_s":0.657389,"scheduling_latency_s":0.657402}1500gitlab # [ 151.814984] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c796d0d94832f85a4ea69779","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c796d0d94832f85a4ea69779: done: 0.009644 sec","job_status":"done","queue_duration_s":0.657389,"scheduling_latency_s":0.657402,"redis_calls":13,"redis_duration_s":0.001404,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009644,"completed_at":"2026-09-03T10:15:30.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 151.869366] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa350291a32ef6c95d1bdc62","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa350291a32ef6c95d1bdc62: start","job_status":"start","queue_duration_s":0.668076,"scheduling_latency_s":0.66809}1502gitlab # [ 151.870126] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa350291a32ef6c95d1bdc62","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa350291a32ef6c95d1bdc62: done: 0.010813 sec","job_status":"done","queue_duration_s":0.668076,"scheduling_latency_s":0.66809,"redis_calls":13,"redis_duration_s":0.0024400000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001391,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010813,"completed_at":"2026-09-03T10:15:30.334Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 151.924656] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd524be136b68fca4d60c724","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd524be136b68fca4d60c724: start","job_status":"start","queue_duration_s":0.679726,"scheduling_latency_s":0.679741}1504gitlab # [ 151.925627] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd524be136b68fca4d60c724","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd524be136b68fca4d60c724: done: 0.009439 sec","job_status":"done","queue_duration_s":0.679726,"scheduling_latency_s":0.679741,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009439,"completed_at":"2026-09-03T10:15:30.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 151.967915] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f0748b09be9a4e1a75fc689","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f0748b09be9a4e1a75fc689: start","job_status":"start","queue_duration_s":0.691802,"scheduling_latency_s":0.691817}1506gitlab # [ 151.968749] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f0748b09be9a4e1a75fc689","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f0748b09be9a4e1a75fc689: done: 0.02081 sec","job_status":"done","queue_duration_s":0.691802,"scheduling_latency_s":0.691817,"redis_calls":13,"redis_duration_s":0.012009,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02081,"completed_at":"2026-09-03T10:15:30.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 152.009988] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d32b9d985ba1c6bb76b7e05b","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d32b9d985ba1c6bb76b7e05b: start","job_status":"start","queue_duration_s":0.716166,"scheduling_latency_s":0.71618}1508gitlab # [ 152.010514] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d32b9d985ba1c6bb76b7e05b","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d32b9d985ba1c6bb76b7e05b: done: 0.018556 sec","job_status":"done","queue_duration_s":0.716166,"scheduling_latency_s":0.71618,"redis_calls":13,"redis_duration_s":0.009573,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002404,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018556,"completed_at":"2026-09-03T10:15:30.390Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 152.053086] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"700e7aac710a6a4f8da397fc","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-700e7aac710a6a4f8da397fc: start","job_status":"start","queue_duration_s":0.735803,"scheduling_latency_s":0.735816}1510gitlab # [ 152.053821] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"700e7aac710a6a4f8da397fc","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-700e7aac710a6a4f8da397fc: done: 0.009804 sec","job_status":"done","queue_duration_s":0.735803,"scheduling_latency_s":0.735816,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009804,"completed_at":"2026-09-03T10:15:30.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 152.094080] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d61f2d25bdde14c5347b0c5","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d61f2d25bdde14c5347b0c5: start","job_status":"start","queue_duration_s":0.74677,"scheduling_latency_s":0.746784}1512gitlab # [ 152.094858] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d61f2d25bdde14c5347b0c5","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d61f2d25bdde14c5347b0c5: done: 0.009967 sec","job_status":"done","queue_duration_s":0.74677,"scheduling_latency_s":0.746784,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000458,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009967,"completed_at":"2026-09-03T10:15:30.412Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 152.146306] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0a18f5c8d5cc80940a7a285","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0a18f5c8d5cc80940a7a285: start","job_status":"start","queue_duration_s":0.757961,"scheduling_latency_s":0.757976}1514gitlab # [ 152.147092] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0a18f5c8d5cc80940a7a285","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0a18f5c8d5cc80940a7a285: done: 0.009619 sec","job_status":"done","queue_duration_s":0.757961,"scheduling_latency_s":0.757976,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009619,"completed_at":"2026-09-03T10:15:30.423Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 152.203031] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f00954c2f39f3681387dc7d","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f00954c2f39f3681387dc7d: start","job_status":"start","queue_duration_s":0.768373,"scheduling_latency_s":0.768385}1516gitlab # [ 152.203734] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:15:30.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f00954c2f39f3681387dc7d","created_at":"2026-09-03T10:15:29.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-4707b5d6bc164584","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"bdf84381746a3e3b395117e3aa61e5ce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:15:29.655Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f00954c2f39f3681387dc7d: done: 0.014369 sec","job_status":"done","queue_duration_s":0.768373,"scheduling_latency_s":0.768385,"redis_calls":13,"redis_duration_s":0.002301,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001174,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014369,"completed_at":"2026-09-03T10:15:30.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 152.408131] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2003129155 wd_nsec: 20031287331518gitlab # [ 166.181942] setup-gitlab-start[2246]: W, [2026-09-03T10:15:46.346861 #2246] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1519gitlab # [ 181.029240] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"60bc273b89e471ca4c44201b","created_at":"2026-09-03T10:16:01.137Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf303b0a348a1ebdb4bf02da20c278ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.189Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-60bc273b89e471ca4c44201b: start","job_status":"start","queue_duration_s":0.004144,"scheduling_latency_s":0.004213}1520gitlab # [ 181.239471] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.404Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"60bc273b89e471ca4c44201b","created_at":"2026-09-03T10:16:01.137Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf303b0a348a1ebdb4bf02da20c278ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.189Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-60bc273b89e471ca4c44201b: done: 0.21103 sec","job_status":"done","queue_duration_s":0.004144,"scheduling_latency_s":0.004213,"redis_calls":9,"redis_duration_s":0.035192,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.029798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005394,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002362311,"exclusive_lock_hold_duration_s":0.044071523,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.21103,"completed_at":"2026-09-03T10:16:01.404Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.102684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 181.306255] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"65d36465c2b1dc6920cb9233","created_at":"2026-09-03T10:16:01.266Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1eab472fb58f6465c767d0ab6127481d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.276Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-65d36465c2b1dc6920cb9233: start","job_status":"start","queue_duration_s":0.195361,"scheduling_latency_s":0.195394}1522gitlab # [ 181.506390] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"65d36465c2b1dc6920cb9233","created_at":"2026-09-03T10:16:01.266Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1eab472fb58f6465c767d0ab6127481d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.276Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-65d36465c2b1dc6920cb9233: done: 0.199836 sec","job_status":"done","queue_duration_s":0.195361,"scheduling_latency_s":0.195394,"redis_calls":9,"redis_duration_s":0.043643,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.040414,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.007885639,"exclusive_lock_hold_duration_s":0.072200797,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.199836,"completed_at":"2026-09-03T10:16:01.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.063413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 181.554889] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b6236efb9f9dfd371d6cfdb7","created_at":"2026-09-03T10:16:01.286Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2152820dc29446946e1458c407e94715","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.290Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b6236efb9f9dfd371d6cfdb7: start","job_status":"start","queue_duration_s":0.429884,"scheduling_latency_s":0.429915}1524gitlab # [ 181.597244] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.762Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1525gitlab # [ 181.617300] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.782Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b6236efb9f9dfd371d6cfdb7","created_at":"2026-09-03T10:16:01.286Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2152820dc29446946e1458c407e94715","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.290Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b6236efb9f9dfd371d6cfdb7: done: 0.062346 sec","job_status":"done","queue_duration_s":0.429884,"scheduling_latency_s":0.429915,"redis_calls":7,"redis_duration_s":0.020941,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005556,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.015385,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.062346,"completed_at":"2026-09-03T10:16:01.782Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 181.638996] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"48343bdb3623a7454e9d15c6","created_at":"2026-09-03T10:16:01.296Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4d608b371e21403098806a47099a717","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.299Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-48343bdb3623a7454e9d15c6: start","job_status":"start","queue_duration_s":0.489571,"scheduling_latency_s":0.489616}1527gitlab # [ 181.671835] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.837Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1528gitlab # [ 181.683550] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.848Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"48343bdb3623a7454e9d15c6","created_at":"2026-09-03T10:16:01.296Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4d608b371e21403098806a47099a717","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.299Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-48343bdb3623a7454e9d15c6: done: 0.059225 sec","job_status":"done","queue_duration_s":0.489571,"scheduling_latency_s":0.489616,"redis_calls":7,"redis_duration_s":0.038556,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.036833,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059225,"completed_at":"2026-09-03T10:16:01.848Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 181.685760] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f6624e272fe8a370e7c3462c","created_at":"2026-09-03T10:16:01.308Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2873ecb774359daf18a1ca597d443540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.310Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f6624e272fe8a370e7c3462c: start","job_status":"start","queue_duration_s":0.540366,"scheduling_latency_s":0.540402}1530gitlab # [ 181.721569] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f6624e272fe8a370e7c3462c","created_at":"2026-09-03T10:16:01.308Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2873ecb774359daf18a1ca597d443540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.310Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f6624e272fe8a370e7c3462c: done: 0.035607 sec","job_status":"done","queue_duration_s":0.540366,"scheduling_latency_s":0.540402,"redis_calls":14,"redis_duration_s":0.004477,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000418,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003123,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035607,"completed_at":"2026-09-03T10:16:01.886Z","load_balancing_strategy":"primary","db_duration_s":0.001122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 181.729599] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.888Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"170c01a483888614faff0e5f","created_at":"2026-09-03T10:16:01.314Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd7cb03f920349f2ec6c1496f7e84981","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.321Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-170c01a483888614faff0e5f: start","job_status":"start","queue_duration_s":0.56679,"scheduling_latency_s":0.566818}1532gitlab # [ 181.779152] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.902Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"170c01a483888614faff0e5f","created_at":"2026-09-03T10:16:01.314Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd7cb03f920349f2ec6c1496f7e84981","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.321Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-170c01a483888614faff0e5f: done: 0.014374 sec","job_status":"done","queue_duration_s":0.56679,"scheduling_latency_s":0.566818,"redis_calls":12,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000324,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021567,"duration_s":0.014374,"completed_at":"2026-09-03T10:16:01.902Z","load_balancing_strategy":"primary","db_duration_s":0.000929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 181.780774] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.903Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6e99c8749520a3e1abf66088","created_at":"2026-09-03T10:16:01.325Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3b5d0655ddde169cf118e5db5fc0077","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.327Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6e99c8749520a3e1abf66088: start","job_status":"start","queue_duration_s":0.575917,"scheduling_latency_s":0.575931}1534gitlab # [ 181.822901] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.919Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6e99c8749520a3e1abf66088","created_at":"2026-09-03T10:16:01.325Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3b5d0655ddde169cf118e5db5fc0077","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.327Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6e99c8749520a3e1abf66088: done: 0.015882 sec","job_status":"done","queue_duration_s":0.575917,"scheduling_latency_s":0.575931,"redis_calls":10,"redis_duration_s":0.002692,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001483,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001209,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00488414,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.015882,"completed_at":"2026-09-03T10:16:01.919Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003351,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1535gitlab # [ 181.833637] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"b5975591f75bb17117f82b73","created_at":"2026-09-03T10:16:01.333Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54826e6fde512eaba2b6952f68100dda","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:16:01.334Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-b5975591f75bb17117f82b73: start","job_status":"start","queue_duration_s":0.586418,"scheduling_latency_s":0.586431}1536gitlab # [ 181.847711] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.935Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"b5975591f75bb17117f82b73","created_at":"2026-09-03T10:16:01.333Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54826e6fde512eaba2b6952f68100dda","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:16:01.334Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-b5975591f75bb17117f82b73: done: 0.014851 sec","job_status":"done","queue_duration_s":0.586418,"scheduling_latency_s":0.586431,"redis_calls":7,"redis_duration_s":0.0017310000000000001,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014851,"completed_at":"2026-09-03T10:16:01.935Z","load_balancing_strategy":"primary","db_duration_s":0.002346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 181.890269] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:01.936Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"b4c8c2e78a1781bb41558698","created_at":"2026-09-03T10:16:01.345Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"838f4ee6d16e856076c8225ca753429f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.347Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-b4c8c2e78a1781bb41558698: start","job_status":"start","queue_duration_s":0.58886,"scheduling_latency_s":0.588874}1538gitlab # [ 181.937110] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.102Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"b4c8c2e78a1781bb41558698","created_at":"2026-09-03T10:16:01.345Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"838f4ee6d16e856076c8225ca753429f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.347Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-b4c8c2e78a1781bb41558698: done: 0.165622 sec","job_status":"done","queue_duration_s":0.58886,"scheduling_latency_s":0.588874,"redis_calls":11,"redis_duration_s":0.002577,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000323226,"exclusive_lock_hold_duration_s":0.15226181,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.165622,"completed_at":"2026-09-03T10:16:02.102Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.069917,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 181.938289] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"403b60b70e123de818da9d0b","created_at":"2026-09-03T10:16:01.351Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12c6eadd07e1bbbe3e1d175955949b71","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:16:01.352Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-403b60b70e123de818da9d0b: start","job_status":"start","queue_duration_s":0.750938,"scheduling_latency_s":0.750953}1540gitlab # [ 181.949879] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.109Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1541gitlab # [ 181.989729] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"403b60b70e123de818da9d0b","created_at":"2026-09-03T10:16:01.351Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12c6eadd07e1bbbe3e1d175955949b71","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:16:01.352Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-403b60b70e123de818da9d0b: done: 0.008442 sec","job_status":"done","queue_duration_s":0.750938,"scheduling_latency_s":0.750953,"redis_calls":7,"redis_duration_s":0.000983,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008442,"completed_at":"2026-09-03T10:16:02.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 181.991133] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"2aa0c6f20844bf05ee22fbb6","created_at":"2026-09-03T10:16:01.355Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8ca68e3017a4cf54ccd33db939093d6","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.362Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-2aa0c6f20844bf05ee22fbb6: start","job_status":"start","queue_duration_s":0.750786,"scheduling_latency_s":0.750799}1543gitlab # [ 182.002793] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"2aa0c6f20844bf05ee22fbb6","created_at":"2026-09-03T10:16:01.355Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8ca68e3017a4cf54ccd33db939093d6","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.362Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-2aa0c6f20844bf05ee22fbb6: done: 0.018138 sec","job_status":"done","queue_duration_s":0.750786,"scheduling_latency_s":0.750799,"redis_calls":10,"redis_duration_s":0.001988,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000395,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279645,"duration_s":0.018138,"completed_at":"2026-09-03T10:16:02.131Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 182.046041] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"55c60227eb5e715dda61455c","created_at":"2026-09-03T10:16:01.363Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8da742b83f7b3e874821d89f529f7d96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:16:01.364Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-55c60227eb5e715dda61455c: start","job_status":"start","queue_duration_s":0.767273,"scheduling_latency_s":0.767286}1545gitlab # [ 182.053772] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.137Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1546gitlab # [ 182.095725] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"55c60227eb5e715dda61455c","created_at":"2026-09-03T10:16:01.363Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8da742b83f7b3e874821d89f529f7d96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:16:01.364Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-55c60227eb5e715dda61455c: done: 0.008122 sec","job_status":"done","queue_duration_s":0.767273,"scheduling_latency_s":0.767286,"redis_calls":7,"redis_duration_s":0.001336,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000356,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008122,"completed_at":"2026-09-03T10:16:02.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 182.096962] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.141Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2073453890dae732b0776ff6","created_at":"2026-09-03T10:16:01.370Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ff1c3b8cca62d1d387e46daabaff4d4","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.375Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2073453890dae732b0776ff6: start","job_status":"start","queue_duration_s":0.76599,"scheduling_latency_s":0.766003}1548gitlab # [ 182.192469] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.357Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2073453890dae732b0776ff6","created_at":"2026-09-03T10:16:01.370Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ff1c3b8cca62d1d387e46daabaff4d4","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.375Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2073453890dae732b0776ff6: done: 0.216333 sec","job_status":"done","queue_duration_s":0.76599,"scheduling_latency_s":0.766003,"redis_calls":562,"redis_duration_s":0.067637,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.066758,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.173382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.216333,"completed_at":"2026-09-03T10:16:02.357Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 182.229373] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.358Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"7179d57c60fd4d8ace24befb","created_at":"2026-09-03T10:16:01.377Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"ee280349d92584902191ca7d6a3dbc8d","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.388Z","job_size_bytes":3,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-7179d57c60fd4d8ace24befb: start","job_status":"start","queue_duration_s":0.970359,"scheduling_latency_s":0.970383}1550gitlab # [ 182.229954] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.372Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"7179d57c60fd4d8ace24befb","created_at":"2026-09-03T10:16:01.377Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"ee280349d92584902191ca7d6a3dbc8d","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.388Z","job_size_bytes":3,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-7179d57c60fd4d8ace24befb: done: 0.013341 sec","job_status":"done","queue_duration_s":0.970359,"scheduling_latency_s":0.970383,"redis_calls":10,"redis_duration_s":0.001415,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000298,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276293,"duration_s":0.013341,"completed_at":"2026-09-03T10:16:02.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000613,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 182.240062] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.373Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"c0ac56e3bda1e4706b150ab7","created_at":"2026-09-03T10:16:01.397Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.492Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-c0ac56e3bda1e4706b150ab7: start","job_status":"start","queue_duration_s":0.880809,"scheduling_latency_s":0.880823}1552gitlab # [ 182.311397] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.475Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"c0ac56e3bda1e4706b150ab7","created_at":"2026-09-03T10:16:01.397Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.492Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-c0ac56e3bda1e4706b150ab7: done: 0.102654 sec","job_status":"done","queue_duration_s":0.880809,"scheduling_latency_s":0.880823,"redis_calls":65,"redis_duration_s":0.013154,"redis_read_bytes":114,"redis_write_bytes":41332,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000558,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.00079,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37035,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.011308,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.087368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000381054,"duration_s":0.102654,"completed_at":"2026-09-03T10:16:02.475Z","load_balancing_strategy":"primary","db_duration_s":0.000508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 182.312354] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.477Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"02b1e7c88ffece0973aab69e","created_at":"2026-09-03T10:16:01.506Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13e82d832a5cb149ce27896a07f4cda4","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.510Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-02b1e7c88ffece0973aab69e: start","job_status":"start","queue_duration_s":0.967243,"scheduling_latency_s":0.967259}1554gitlab # [ 182.351892] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"02b1e7c88ffece0973aab69e","created_at":"2026-09-03T10:16:01.506Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13e82d832a5cb149ce27896a07f4cda4","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.510Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-02b1e7c88ffece0973aab69e: done: 0.011604 sec","job_status":"done","queue_duration_s":0.967243,"scheduling_latency_s":0.967259,"redis_calls":7,"redis_duration_s":0.001083,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011604,"completed_at":"2026-09-03T10:16:02.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 182.359430] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"88fd6aa668c01f5ac1bbe883","created_at":"2026-09-03T10:16:01.529Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"766bbb9c4d7549645ccc2260f4bc1953","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.540Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-88fd6aa668c01f5ac1bbe883: start","job_status":"start","queue_duration_s":0.949973,"scheduling_latency_s":0.949987}1556gitlab # [ 182.373036] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.494Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1557gitlab # [ 182.375956] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"88fd6aa668c01f5ac1bbe883","created_at":"2026-09-03T10:16:01.529Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"766bbb9c4d7549645ccc2260f4bc1953","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.540Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-88fd6aa668c01f5ac1bbe883: done: 0.008113 sec","job_status":"done","queue_duration_s":0.949973,"scheduling_latency_s":0.949987,"redis_calls":7,"redis_duration_s":0.0009660000000000001,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008113,"completed_at":"2026-09-03T10:16:02.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 182.428774] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"372c695b045c8b9129a92d82","created_at":"2026-09-03T10:16:01.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d85e5ad766aaf1d0edf237c3108c8bcd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.562Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-372c695b045c8b9129a92d82: start","job_status":"start","queue_duration_s":0.936669,"scheduling_latency_s":0.936681}1559gitlab # [ 182.429624] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.507Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"372c695b045c8b9129a92d82","created_at":"2026-09-03T10:16:01.558Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d85e5ad766aaf1d0edf237c3108c8bcd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.562Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-372c695b045c8b9129a92d82: done: 0.008269 sec","job_status":"done","queue_duration_s":0.936669,"scheduling_latency_s":0.936681,"redis_calls":7,"redis_duration_s":0.001573,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000869,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008269,"completed_at":"2026-09-03T10:16:02.507Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 182.464031] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.508Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"dbd3bd6da7600faaa89aa718","created_at":"2026-09-03T10:16:01.568Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f906721c569ad9d79ad55cdb8f6c6eec","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-dbd3bd6da7600faaa89aa718: start","job_status":"start","queue_duration_s":0.936274,"scheduling_latency_s":0.936286}1561gitlab # [ 182.476384] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"dbd3bd6da7600faaa89aa718","created_at":"2026-09-03T10:16:01.568Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f906721c569ad9d79ad55cdb8f6c6eec","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-dbd3bd6da7600faaa89aa718: done: 0.011494 sec","job_status":"done","queue_duration_s":0.936274,"scheduling_latency_s":0.936286,"redis_calls":9,"redis_duration_s":0.001564,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000759,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000805,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000349766,"exclusive_lock_hold_duration_s":0.00275035,"duration_s":0.011494,"completed_at":"2026-09-03T10:16:02.520Z","load_balancing_strategy":"primary","db_duration_s":0.00113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 182.518138] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4a3825ae188aa243fb1e5269","created_at":"2026-09-03T10:16:01.578Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.581Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4a3825ae188aa243fb1e5269: start","job_status":"start","queue_duration_s":0.939519,"scheduling_latency_s":0.939533}1563gitlab # [ 182.524851] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.578Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4a3825ae188aa243fb1e5269","created_at":"2026-09-03T10:16:01.578Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.581Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4a3825ae188aa243fb1e5269: done: 0.057188 sec","job_status":"done","queue_duration_s":0.939519,"scheduling_latency_s":0.939533,"redis_calls":60,"redis_duration_s":0.008727,"redis_read_bytes":109,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000598,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.007727,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000402,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.057188,"completed_at":"2026-09-03T10:16:02.578Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 182.593894] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d9010f788ee24214934aaf5e","created_at":"2026-09-03T10:16:01.597Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d5a4c24d4b95fbc623e5635a5c76394","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.602Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d9010f788ee24214934aaf5e: start","job_status":"start","queue_duration_s":0.977157,"scheduling_latency_s":0.977176}1565gitlab # [ 182.594851] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d9010f788ee24214934aaf5e","created_at":"2026-09-03T10:16:01.597Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d5a4c24d4b95fbc623e5635a5c76394","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.602Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d9010f788ee24214934aaf5e: done: 0.014222 sec","job_status":"done","queue_duration_s":0.977157,"scheduling_latency_s":0.977176,"redis_calls":7,"redis_duration_s":0.0010840000000000001,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.014222,"completed_at":"2026-09-03T10:16:02.593Z","load_balancing_strategy":"primary","db_duration_s":0.004271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 182.612488] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4b6fdebe693fefca4a44188c","created_at":"2026-09-03T10:16:01.616Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f482be8e222705cf930d5e41ae5ff8f4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.620Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4b6fdebe693fefca4a44188c: start","job_status":"start","queue_duration_s":0.975041,"scheduling_latency_s":0.975057}1567gitlab # [ 182.655058] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4b6fdebe693fefca4a44188c","created_at":"2026-09-03T10:16:01.616Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f482be8e222705cf930d5e41ae5ff8f4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.620Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4b6fdebe693fefca4a44188c: done: 0.008109 sec","job_status":"done","queue_duration_s":0.975041,"scheduling_latency_s":0.975057,"redis_calls":7,"redis_duration_s":0.0009209999999999999,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008109,"completed_at":"2026-09-03T10:16:02.603Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 182.662317] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7fa2d42265ff759f65bc5f10","created_at":"2026-09-03T10:16:01.660Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"304de4c132d8332ffdbf68133d715770","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.665Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7fa2d42265ff759f65bc5f10: start","job_status":"start","queue_duration_s":0.939264,"scheduling_latency_s":0.939277}1569gitlab # [ 182.675517] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7fa2d42265ff759f65bc5f10","created_at":"2026-09-03T10:16:01.660Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"304de4c132d8332ffdbf68133d715770","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.665Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7fa2d42265ff759f65bc5f10: done: 0.010693 sec","job_status":"done","queue_duration_s":0.939264,"scheduling_latency_s":0.939277,"redis_calls":9,"redis_duration_s":0.001251,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000339988,"exclusive_lock_hold_duration_s":0.002839746,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.010693,"completed_at":"2026-09-03T10:16:02.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 182.717852] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"a003a18ea6c6cbaf86b039c5","created_at":"2026-09-03T10:16:01.714Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39f65a6f35bfaa3a83353052e4532265","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.719Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-a003a18ea6c6cbaf86b039c5: start","job_status":"start","queue_duration_s":0.896534,"scheduling_latency_s":0.896547}1571gitlab # [ 182.763836] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.620Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1572gitlab # [ 182.764951] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"a003a18ea6c6cbaf86b039c5","created_at":"2026-09-03T10:16:01.714Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39f65a6f35bfaa3a83353052e4532265","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.719Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-a003a18ea6c6cbaf86b039c5: done: 0.007898 sec","job_status":"done","queue_duration_s":0.896534,"scheduling_latency_s":0.896547,"redis_calls":7,"redis_duration_s":0.000868,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000623,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007898,"completed_at":"2026-09-03T10:16:02.623Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 182.767319] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"85c9e61d83e79162dd8df403","created_at":"2026-09-03T10:16:01.756Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"635a20935c3ea16fbc7944616c64433f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.774Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-85c9e61d83e79162dd8df403: start","job_status":"start","queue_duration_s":0.850607,"scheduling_latency_s":0.850621}1574gitlab # [ 182.818256] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.642Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"85c9e61d83e79162dd8df403","created_at":"2026-09-03T10:16:01.756Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"635a20935c3ea16fbc7944616c64433f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.774Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-85c9e61d83e79162dd8df403: done: 0.018223 sec","job_status":"done","queue_duration_s":0.850607,"scheduling_latency_s":0.850621,"redis_calls":12,"redis_duration_s":0.0015400000000000001,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000568,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000326019,"exclusive_lock_hold_duration_s":0.004720991,"duration_s":0.018223,"completed_at":"2026-09-03T10:16:02.642Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 182.820375] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.643Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"83e97dd3bbb216c533f69b3c","created_at":"2026-09-03T10:16:01.783Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17a2c900fa276a74ed1a060e5a57d9e0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.787Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-83e97dd3bbb216c533f69b3c: start","job_status":"start","queue_duration_s":0.856575,"scheduling_latency_s":0.856589}1576gitlab # [ 182.869975] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.657Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"83e97dd3bbb216c533f69b3c","created_at":"2026-09-03T10:16:01.783Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-3dc5c13e23b14afd","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17a2c900fa276a74ed1a060e5a57d9e0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.787Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-83e97dd3bbb216c533f69b3c: done: 0.013386 sec","job_status":"done","queue_duration_s":0.856575,"scheduling_latency_s":0.856589,"redis_calls":7,"redis_duration_s":0.00097,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013386,"completed_at":"2026-09-03T10:16:02.657Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003408,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 182.871750] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.658Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bb770bcd64b04d48bce3eaf9","created_at":"2026-09-03T10:16:01.867Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-2755066898504343","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2873ecb774359daf18a1ca597d443540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.880Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bb770bcd64b04d48bce3eaf9: start","job_status":"start","queue_duration_s":0.778747,"scheduling_latency_s":0.778786}1578gitlab # [ 182.885055] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.665Z","message":"No existing merge request to be cleaned up."}1579gitlab # [ 182.885863] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.670Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bb770bcd64b04d48bce3eaf9","created_at":"2026-09-03T10:16:01.867Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-2755066898504343","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2873ecb774359daf18a1ca597d443540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.880Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bb770bcd64b04d48bce3eaf9: done: 0.012212 sec","job_status":"done","queue_duration_s":0.778747,"scheduling_latency_s":0.778786,"redis_calls":10,"redis_duration_s":0.0013210000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000811,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012212,"completed_at":"2026-09-03T10:16:02.670Z","load_balancing_strategy":"primary","db_duration_s":0.001311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 182.936736] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.671Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"83eb8147516a0adfc85ecaa2","created_at":"2026-09-03T10:16:01.867Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-2755066898504343","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2873ecb774359daf18a1ca597d443540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.880Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-83eb8147516a0adfc85ecaa2: start","job_status":"start","queue_duration_s":0.791814,"scheduling_latency_s":0.791827}1581gitlab # [ 182.937636] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.679Z","message":"No existing merge request to be cleaned up."}1582gitlab # [ 182.939148] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.683Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"83eb8147516a0adfc85ecaa2","created_at":"2026-09-03T10:16:01.867Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-2755066898504343","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2873ecb774359daf18a1ca597d443540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.880Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-83eb8147516a0adfc85ecaa2: done: 0.011587 sec","job_status":"done","queue_duration_s":0.791814,"scheduling_latency_s":0.791827,"redis_calls":10,"redis_duration_s":0.001521,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000811,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011587,"completed_at":"2026-09-03T10:16:02.683Z","load_balancing_strategy":"primary","db_duration_s":0.001085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 182.969426] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.684Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6a9e4695213d072e61f00eba","created_at":"2026-09-03T10:16:01.867Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-2755066898504343","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2873ecb774359daf18a1ca597d443540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.880Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6a9e4695213d072e61f00eba: start","job_status":"start","queue_duration_s":0.80473,"scheduling_latency_s":0.804743}1584gitlab # [ 183.015591] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.694Z","message":"No existing merge request to be cleaned up."}1585gitlab # [ 183.016544] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.700Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6a9e4695213d072e61f00eba","created_at":"2026-09-03T10:16:01.867Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-2755066898504343","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2873ecb774359daf18a1ca597d443540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.880Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6a9e4695213d072e61f00eba: done: 0.015512 sec","job_status":"done","queue_duration_s":0.80473,"scheduling_latency_s":0.804743,"redis_calls":10,"redis_duration_s":0.001326,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000785,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015512,"completed_at":"2026-09-03T10:16:02.700Z","load_balancing_strategy":"primary","db_duration_s":0.006601,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586gitlab # [ 183.017895] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.701Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b4b286465bd83dc5a6b4c629","created_at":"2026-09-03T10:16:01.867Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-2755066898504343","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2873ecb774359daf18a1ca597d443540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.880Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b4b286465bd83dc5a6b4c629: start","job_status":"start","queue_duration_s":0.821128,"scheduling_latency_s":0.821142}1587gitlab # [ 183.029114] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.710Z","message":"No existing merge request to be cleaned up."}1588gitlab # [ 183.030102] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.715Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b4b286465bd83dc5a6b4c629","created_at":"2026-09-03T10:16:01.867Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-2755066898504343","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2873ecb774359daf18a1ca597d443540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:01.880Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b4b286465bd83dc5a6b4c629: done: 0.014417 sec","job_status":"done","queue_duration_s":0.821128,"scheduling_latency_s":0.821142,"redis_calls":10,"redis_duration_s":0.001349,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014417,"completed_at":"2026-09-03T10:16:02.715Z","load_balancing_strategy":"primary","db_duration_s":0.004955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 183.100195] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"260791b1c0dc97037ed86b7c","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-260791b1c0dc97037ed86b7c: start","job_status":"start","queue_duration_s":0.252155,"scheduling_latency_s":0.252171}1590gitlab # [ 183.100966] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"260791b1c0dc97037ed86b7c","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-260791b1c0dc97037ed86b7c: done: 0.021717 sec","job_status":"done","queue_duration_s":0.252155,"scheduling_latency_s":0.252171,"redis_calls":13,"redis_duration_s":0.0016510000000000001,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231314,"duration_s":0.021717,"completed_at":"2026-09-03T10:16:02.738Z","load_balancing_strategy":"primary","db_duration_s":0.003753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 183.113961] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7342aeb2d1c9d5fd64803ef4","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7342aeb2d1c9d5fd64803ef4: start","job_status":"start","queue_duration_s":0.274798,"scheduling_latency_s":0.274811}1592gitlab # [ 183.126043] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7342aeb2d1c9d5fd64803ef4","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7342aeb2d1c9d5fd64803ef4: done: 0.010913 sec","job_status":"done","queue_duration_s":0.274798,"scheduling_latency_s":0.274811,"redis_calls":10,"redis_duration_s":0.001286,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000758,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010913,"completed_at":"2026-09-03T10:16:02.750Z","load_balancing_strategy":"primary","db_duration_s":0.000928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 183.188537] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"581e87b6cc1068b285b9dbe9","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-581e87b6cc1068b285b9dbe9: start","job_status":"start","queue_duration_s":0.286551,"scheduling_latency_s":0.286565}1594gitlab # [ 183.189280] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"581e87b6cc1068b285b9dbe9","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-581e87b6cc1068b285b9dbe9: done: 0.011895 sec","job_status":"done","queue_duration_s":0.286551,"scheduling_latency_s":0.286565,"redis_calls":10,"redis_duration_s":0.00134,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00079,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011895,"completed_at":"2026-09-03T10:16:02.763Z","load_balancing_strategy":"primary","db_duration_s":0.000986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 183.207822] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0a03089918594e7ad7e77308","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0a03089918594e7ad7e77308: start","job_status":"start","queue_duration_s":0.299295,"scheduling_latency_s":0.299308}1596gitlab # [ 183.257247] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0a03089918594e7ad7e77308","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0a03089918594e7ad7e77308: done: 0.011153 sec","job_status":"done","queue_duration_s":0.299295,"scheduling_latency_s":0.299308,"redis_calls":10,"redis_duration_s":0.001397,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000851,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011153,"completed_at":"2026-09-03T10:16:02.775Z","load_balancing_strategy":"primary","db_duration_s":0.000952,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 183.257817] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e6f6904f6ab4bf7dade8e6b8","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e6f6904f6ab4bf7dade8e6b8: start","job_status":"start","queue_duration_s":0.3115,"scheduling_latency_s":0.311514}1598gitlab # [ 183.264651] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e6f6904f6ab4bf7dade8e6b8","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e6f6904f6ab4bf7dade8e6b8: done: 0.011099 sec","job_status":"done","queue_duration_s":0.3115,"scheduling_latency_s":0.311514,"redis_calls":10,"redis_duration_s":0.001327,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000785,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011099,"completed_at":"2026-09-03T10:16:02.787Z","load_balancing_strategy":"primary","db_duration_s":0.000966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 183.305487] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"50a5aa868a54e3c9dabb1464","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-50a5aa868a54e3c9dabb1464: start","job_status":"start","queue_duration_s":0.323411,"scheduling_latency_s":0.323432}1600gitlab # [ 183.310055] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"50a5aa868a54e3c9dabb1464","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-50a5aa868a54e3c9dabb1464: done: 0.011317 sec","job_status":"done","queue_duration_s":0.323411,"scheduling_latency_s":0.323432,"redis_calls":10,"redis_duration_s":0.001584,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000835,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011317,"completed_at":"2026-09-03T10:16:02.799Z","load_balancing_strategy":"primary","db_duration_s":0.000917,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 183.352885] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"aa531681dd41c47f5d648e8c","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-aa531681dd41c47f5d648e8c: start","job_status":"start","queue_duration_s":0.335594,"scheduling_latency_s":0.335607}1602gitlab # [ 183.355494] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"aa531681dd41c47f5d648e8c","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-aa531681dd41c47f5d648e8c: done: 0.010937 sec","job_status":"done","queue_duration_s":0.335594,"scheduling_latency_s":0.335607,"redis_calls":10,"redis_duration_s":0.001253,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000755,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010937,"completed_at":"2026-09-03T10:16:02.811Z","load_balancing_strategy":"primary","db_duration_s":0.000915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 183.414794] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2d7982d90ca415861629dc2f","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2d7982d90ca415861629dc2f: start","job_status":"start","queue_duration_s":0.347353,"scheduling_latency_s":0.347386}1604gitlab # [ 183.415845] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2d7982d90ca415861629dc2f","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2d7982d90ca415861629dc2f: done: 0.010676 sec","job_status":"done","queue_duration_s":0.347353,"scheduling_latency_s":0.347386,"redis_calls":10,"redis_duration_s":0.001334,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000792,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010676,"completed_at":"2026-09-03T10:16:02.823Z","load_balancing_strategy":"primary","db_duration_s":0.000915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 183.467458] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6c068c499d86682beec913d2","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6c068c499d86682beec913d2: start","job_status":"start","queue_duration_s":0.358908,"scheduling_latency_s":0.358922}1606gitlab # [ 183.468269] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6c068c499d86682beec913d2","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6c068c499d86682beec913d2: done: 0.011286 sec","job_status":"done","queue_duration_s":0.358908,"scheduling_latency_s":0.358922,"redis_calls":10,"redis_duration_s":0.0015439999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011286,"completed_at":"2026-09-03T10:16:02.835Z","load_balancing_strategy":"primary","db_duration_s":0.000926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 183.513545] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"75db0b052638d19f18ce649c","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-75db0b052638d19f18ce649c: start","job_status":"start","queue_duration_s":0.371044,"scheduling_latency_s":0.371057}1608gitlab # [ 183.514636] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"75db0b052638d19f18ce649c","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-75db0b052638d19f18ce649c: done: 0.011001 sec","job_status":"done","queue_duration_s":0.371044,"scheduling_latency_s":0.371057,"redis_calls":10,"redis_duration_s":0.001278,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000732,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011001,"completed_at":"2026-09-03T10:16:02.847Z","load_balancing_strategy":"primary","db_duration_s":0.00092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 183.533186] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d5d3b3d05c940f0fbc1e7aa2","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d5d3b3d05c940f0fbc1e7aa2: start","job_status":"start","queue_duration_s":0.382889,"scheduling_latency_s":0.382903}1610gitlab # [ 183.544748] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d5d3b3d05c940f0fbc1e7aa2","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d5d3b3d05c940f0fbc1e7aa2: done: 0.010915 sec","job_status":"done","queue_duration_s":0.382889,"scheduling_latency_s":0.382903,"redis_calls":10,"redis_duration_s":0.001276,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010915,"completed_at":"2026-09-03T10:16:02.858Z","load_balancing_strategy":"primary","db_duration_s":0.000938,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 183.591350] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"14e27bb68f53fb43c07f435e","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-14e27bb68f53fb43c07f435e: start","job_status":"start","queue_duration_s":0.394626,"scheduling_latency_s":0.394639}1612gitlab # [ 183.592092] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"14e27bb68f53fb43c07f435e","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-14e27bb68f53fb43c07f435e: done: 0.011233 sec","job_status":"done","queue_duration_s":0.394626,"scheduling_latency_s":0.394639,"redis_calls":10,"redis_duration_s":0.001311,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000802,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011233,"completed_at":"2026-09-03T10:16:02.870Z","load_balancing_strategy":"primary","db_duration_s":0.000975,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 183.645640] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6028193e3d0288b7c6387142","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6028193e3d0288b7c6387142: start","job_status":"start","queue_duration_s":0.406696,"scheduling_latency_s":0.40671}1614gitlab # [ 183.646550] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6028193e3d0288b7c6387142","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6028193e3d0288b7c6387142: done: 0.011188 sec","job_status":"done","queue_duration_s":0.406696,"scheduling_latency_s":0.40671,"redis_calls":10,"redis_duration_s":0.0013549999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011188,"completed_at":"2026-09-03T10:16:02.882Z","load_balancing_strategy":"primary","db_duration_s":0.001194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 183.690830] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"57dc504ddeb3ca083722d485","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-57dc504ddeb3ca083722d485: start","job_status":"start","queue_duration_s":0.4187,"scheduling_latency_s":0.418713}1616gitlab # [ 183.691769] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"57dc504ddeb3ca083722d485","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-57dc504ddeb3ca083722d485: done: 0.010822 sec","job_status":"done","queue_duration_s":0.4187,"scheduling_latency_s":0.418713,"redis_calls":10,"redis_duration_s":0.001295,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00077,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010822,"completed_at":"2026-09-03T10:16:02.894Z","load_balancing_strategy":"primary","db_duration_s":0.000968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 183.742587] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e0f842873a2c7ba8ae91fabc","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e0f842873a2c7ba8ae91fabc: start","job_status":"start","queue_duration_s":0.4304,"scheduling_latency_s":0.430414}1618gitlab # [ 183.743370] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e0f842873a2c7ba8ae91fabc","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e0f842873a2c7ba8ae91fabc: done: 0.011162 sec","job_status":"done","queue_duration_s":0.4304,"scheduling_latency_s":0.430414,"redis_calls":10,"redis_duration_s":0.001262,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000764,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011162,"completed_at":"2026-09-03T10:16:02.906Z","load_balancing_strategy":"primary","db_duration_s":0.0009,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 183.795824] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3b794e13433c959b8510833f","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3b794e13433c959b8510833f: start","job_status":"start","queue_duration_s":0.442395,"scheduling_latency_s":0.442409}1620gitlab # [ 183.796730] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3b794e13433c959b8510833f","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3b794e13433c959b8510833f: done: 0.010968 sec","job_status":"done","queue_duration_s":0.442395,"scheduling_latency_s":0.442409,"redis_calls":10,"redis_duration_s":0.001317,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000801,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010968,"completed_at":"2026-09-03T10:16:02.918Z","load_balancing_strategy":"primary","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 183.813672] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c1d6e0b213fbf28392cb17d0","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c1d6e0b213fbf28392cb17d0: start","job_status":"start","queue_duration_s":0.454249,"scheduling_latency_s":0.454262}1622gitlab # [ 183.859498] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c1d6e0b213fbf28392cb17d0","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c1d6e0b213fbf28392cb17d0: done: 0.010851 sec","job_status":"done","queue_duration_s":0.454249,"scheduling_latency_s":0.454262,"redis_calls":10,"redis_duration_s":0.001256,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000731,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010851,"completed_at":"2026-09-03T10:16:02.930Z","load_balancing_strategy":"primary","db_duration_s":0.000931,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 183.860712] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cdb771bf4cbaeeb37dc934bb","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cdb771bf4cbaeeb37dc934bb: start","job_status":"start","queue_duration_s":0.466242,"scheduling_latency_s":0.466256}1624gitlab # [ 183.902829] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cdb771bf4cbaeeb37dc934bb","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cdb771bf4cbaeeb37dc934bb: done: 0.010958 sec","job_status":"done","queue_duration_s":0.466242,"scheduling_latency_s":0.466256,"redis_calls":10,"redis_duration_s":0.001348,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000844,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010958,"completed_at":"2026-09-03T10:16:02.942Z","load_balancing_strategy":"primary","db_duration_s":0.000976,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 183.907402] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8eab5cbf5171a064742b2746","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8eab5cbf5171a064742b2746: start","job_status":"start","queue_duration_s":0.478044,"scheduling_latency_s":0.478058}1626gitlab # [ 183.947521] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8eab5cbf5171a064742b2746","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8eab5cbf5171a064742b2746: done: 0.010912 sec","job_status":"done","queue_duration_s":0.478044,"scheduling_latency_s":0.478058,"redis_calls":10,"redis_duration_s":0.0012850000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000756,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010912,"completed_at":"2026-09-03T10:16:02.954Z","load_balancing_strategy":"primary","db_duration_s":0.000921,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 183.952966] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"11457a99fb5efdf95bdd74b9","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-11457a99fb5efdf95bdd74b9: start","job_status":"start","queue_duration_s":0.48981,"scheduling_latency_s":0.489824}1628gitlab # [ 183.965144] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"11457a99fb5efdf95bdd74b9","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-11457a99fb5efdf95bdd74b9: done: 0.011417 sec","job_status":"done","queue_duration_s":0.48981,"scheduling_latency_s":0.489824,"redis_calls":10,"redis_duration_s":0.001968,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011417,"completed_at":"2026-09-03T10:16:02.966Z","load_balancing_strategy":"primary","db_duration_s":0.000928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 184.026544] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"578b803ae0a104d30d0dc037","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-578b803ae0a104d30d0dc037: start","job_status":"start","queue_duration_s":0.502497,"scheduling_latency_s":0.502511}1630gitlab # [ 184.027441] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"578b803ae0a104d30d0dc037","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-578b803ae0a104d30d0dc037: done: 0.013663 sec","job_status":"done","queue_duration_s":0.502497,"scheduling_latency_s":0.502511,"redis_calls":10,"redis_duration_s":0.0027559999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001041,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013663,"completed_at":"2026-09-03T10:16:02.981Z","load_balancing_strategy":"primary","db_duration_s":0.002371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 184.046860] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:02.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1d947d5de17d8f43443247f4","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1d947d5de17d8f43443247f4: start","job_status":"start","queue_duration_s":0.517336,"scheduling_latency_s":0.517349}1632gitlab # [ 184.058580] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1d947d5de17d8f43443247f4","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1d947d5de17d8f43443247f4: done: 0.019585 sec","job_status":"done","queue_duration_s":0.517336,"scheduling_latency_s":0.517349,"redis_calls":10,"redis_duration_s":0.004267,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002488,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019585,"completed_at":"2026-09-03T10:16:03.001Z","load_balancing_strategy":"primary","db_duration_s":0.005816,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633gitlab # [ 184.111504] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"abcbd13e9cfd1573b8aa6899","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-abcbd13e9cfd1573b8aa6899: start","job_status":"start","queue_duration_s":0.538059,"scheduling_latency_s":0.538073}1634gitlab # [ 184.112372] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"abcbd13e9cfd1573b8aa6899","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-abcbd13e9cfd1573b8aa6899: done: 0.012981 sec","job_status":"done","queue_duration_s":0.538059,"scheduling_latency_s":0.538073,"redis_calls":10,"redis_duration_s":0.00231,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001393,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012981,"completed_at":"2026-09-03T10:16:03.016Z","load_balancing_strategy":"primary","db_duration_s":0.001882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 184.168324] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"38da4abbaed02dcc2fd60985","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-38da4abbaed02dcc2fd60985: start","job_status":"start","queue_duration_s":0.552209,"scheduling_latency_s":0.552222}1636gitlab # [ 184.169040] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"38da4abbaed02dcc2fd60985","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-38da4abbaed02dcc2fd60985: done: 0.013598 sec","job_status":"done","queue_duration_s":0.552209,"scheduling_latency_s":0.552222,"redis_calls":10,"redis_duration_s":0.003133,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001519,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013598,"completed_at":"2026-09-03T10:16:03.030Z","load_balancing_strategy":"primary","db_duration_s":0.001802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 184.185995] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cfa21f92a799b9bacc5c97b9","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cfa21f92a799b9bacc5c97b9: start","job_status":"start","queue_duration_s":0.568504,"scheduling_latency_s":0.568519}1638gitlab # [ 184.197781] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cfa21f92a799b9bacc5c97b9","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cfa21f92a799b9bacc5c97b9: done: 0.026026 sec","job_status":"done","queue_duration_s":0.568504,"scheduling_latency_s":0.568519,"redis_calls":10,"redis_duration_s":0.010662999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005716,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004947,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026026,"completed_at":"2026-09-03T10:16:03.059Z","load_balancing_strategy":"primary","db_duration_s":0.004442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 184.243596] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7e3ddd07b8c71cb96bfb4325","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7e3ddd07b8c71cb96bfb4325: start","job_status":"start","queue_duration_s":0.597843,"scheduling_latency_s":0.597861}1640gitlab # [ 184.244460] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7e3ddd07b8c71cb96bfb4325","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7e3ddd07b8c71cb96bfb4325: done: 0.012296 sec","job_status":"done","queue_duration_s":0.597843,"scheduling_latency_s":0.597861,"redis_calls":10,"redis_duration_s":0.0016229999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012296,"completed_at":"2026-09-03T10:16:03.075Z","load_balancing_strategy":"primary","db_duration_s":0.001016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641gitlab # [ 184.308907] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"08b62a5a9fe7532eea2cbf30","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-08b62a5a9fe7532eea2cbf30: start","job_status":"start","queue_duration_s":0.611187,"scheduling_latency_s":0.6112}1642gitlab # [ 184.309806] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"08b62a5a9fe7532eea2cbf30","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-08b62a5a9fe7532eea2cbf30: done: 0.012329 sec","job_status":"done","queue_duration_s":0.611187,"scheduling_latency_s":0.6112,"redis_calls":10,"redis_duration_s":0.0019529999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012329,"completed_at":"2026-09-03T10:16:03.088Z","load_balancing_strategy":"primary","db_duration_s":0.001718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643gitlab # [ 184.354911] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0fdec22cea0c92b65de5ab2e","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0fdec22cea0c92b65de5ab2e: start","job_status":"start","queue_duration_s":0.624529,"scheduling_latency_s":0.624542}1644gitlab # [ 184.355630] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0fdec22cea0c92b65de5ab2e","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0fdec22cea0c92b65de5ab2e: done: 0.01186 sec","job_status":"done","queue_duration_s":0.624529,"scheduling_latency_s":0.624542,"redis_calls":10,"redis_duration_s":0.001833,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01186,"completed_at":"2026-09-03T10:16:03.101Z","load_balancing_strategy":"primary","db_duration_s":0.001464,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645gitlab # [ 184.370723] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9379d01e39c36bf2eea2dcf7","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9379d01e39c36bf2eea2dcf7: start","job_status":"start","queue_duration_s":0.639954,"scheduling_latency_s":0.639968}1646gitlab # [ 184.382257] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9379d01e39c36bf2eea2dcf7","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9379d01e39c36bf2eea2dcf7: done: 0.021373 sec","job_status":"done","queue_duration_s":0.639954,"scheduling_latency_s":0.639968,"redis_calls":10,"redis_duration_s":0.006219000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004136,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021373,"completed_at":"2026-09-03T10:16:03.126Z","load_balancing_strategy":"primary","db_duration_s":0.007789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647gitlab # [ 184.435360] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e67195caeedf5a435481e9e1","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e67195caeedf5a435481e9e1: start","job_status":"start","queue_duration_s":0.664017,"scheduling_latency_s":0.664033}1648gitlab # [ 184.436070] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e67195caeedf5a435481e9e1","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e67195caeedf5a435481e9e1: done: 0.017225 sec","job_status":"done","queue_duration_s":0.664017,"scheduling_latency_s":0.664033,"redis_calls":10,"redis_duration_s":0.004567,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001781,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002786,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017225,"completed_at":"2026-09-03T10:16:03.146Z","load_balancing_strategy":"primary","db_duration_s":0.003493,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 184.463557] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d7d9026f616b3b759319965b","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d7d9026f616b3b759319965b: start","job_status":"start","queue_duration_s":0.682131,"scheduling_latency_s":0.682145}1650gitlab # [ 184.474987] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d7d9026f616b3b759319965b","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d7d9026f616b3b759319965b: done: 0.01137 sec","job_status":"done","queue_duration_s":0.682131,"scheduling_latency_s":0.682145,"redis_calls":10,"redis_duration_s":0.001603,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01137,"completed_at":"2026-09-03T10:16:03.158Z","load_balancing_strategy":"primary","db_duration_s":0.001064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651gitlab # [ 184.526319] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"41e5d1522b35eef29bdf3d78","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-41e5d1522b35eef29bdf3d78: start","job_status":"start","queue_duration_s":0.694368,"scheduling_latency_s":0.694381}1652gitlab # [ 184.527045] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"41e5d1522b35eef29bdf3d78","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-41e5d1522b35eef29bdf3d78: done: 0.010764 sec","job_status":"done","queue_duration_s":0.694368,"scheduling_latency_s":0.694381,"redis_calls":10,"redis_duration_s":0.001385,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000791,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010764,"completed_at":"2026-09-03T10:16:03.170Z","load_balancing_strategy":"primary","db_duration_s":0.001012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653gitlab # [ 184.566375] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d434a7bb59d73b1c8ff2727a","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d434a7bb59d73b1c8ff2727a: start","job_status":"start","queue_duration_s":0.70599,"scheduling_latency_s":0.706004}1654gitlab # [ 184.567104] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d434a7bb59d73b1c8ff2727a","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d434a7bb59d73b1c8ff2727a: done: 0.011026 sec","job_status":"done","queue_duration_s":0.70599,"scheduling_latency_s":0.706004,"redis_calls":10,"redis_duration_s":0.001618,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000834,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011026,"completed_at":"2026-09-03T10:16:03.182Z","load_balancing_strategy":"primary","db_duration_s":0.001052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1655gitlab # [ 184.608784] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"731882da83b06c864e0c15a4","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-731882da83b06c864e0c15a4: start","job_status":"start","queue_duration_s":0.719946,"scheduling_latency_s":0.71996}1656gitlab # [ 184.611860] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"731882da83b06c864e0c15a4","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-731882da83b06c864e0c15a4: done: 0.018334 sec","job_status":"done","queue_duration_s":0.719946,"scheduling_latency_s":0.71996,"redis_calls":10,"redis_duration_s":0.0064340000000000005,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003563,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018334,"completed_at":"2026-09-03T10:16:03.203Z","load_balancing_strategy":"primary","db_duration_s":0.002747,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657gitlab # [ 184.674263] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a8755e452b606f8894ee3925","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a8755e452b606f8894ee3925: start","job_status":"start","queue_duration_s":0.740941,"scheduling_latency_s":0.740956}1658gitlab # [ 184.675341] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a8755e452b606f8894ee3925","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a8755e452b606f8894ee3925: done: 0.020433 sec","job_status":"done","queue_duration_s":0.740941,"scheduling_latency_s":0.740956,"redis_calls":10,"redis_duration_s":0.007273,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004358,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020433,"completed_at":"2026-09-03T10:16:03.226Z","load_balancing_strategy":"primary","db_duration_s":0.004037,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659gitlab # [ 184.719778] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e00aa38dd102b92412400a0c","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e00aa38dd102b92412400a0c: start","job_status":"start","queue_duration_s":0.762271,"scheduling_latency_s":0.762286}1660gitlab # [ 184.720836] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e00aa38dd102b92412400a0c","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e00aa38dd102b92412400a0c: done: 0.011178 sec","job_status":"done","queue_duration_s":0.762271,"scheduling_latency_s":0.762286,"redis_calls":10,"redis_duration_s":0.001375,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000819,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011178,"completed_at":"2026-09-03T10:16:03.238Z","load_balancing_strategy":"primary","db_duration_s":0.001073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661gitlab # [ 184.765844] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"063dbfb692a439e5bf4cfba6","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-063dbfb692a439e5bf4cfba6: start","job_status":"start","queue_duration_s":0.774357,"scheduling_latency_s":0.77437}1662gitlab # [ 184.766896] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"063dbfb692a439e5bf4cfba6","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-063dbfb692a439e5bf4cfba6: done: 0.011072 sec","job_status":"done","queue_duration_s":0.774357,"scheduling_latency_s":0.77437,"redis_calls":10,"redis_duration_s":0.0013340000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000787,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011072,"completed_at":"2026-09-03T10:16:03.250Z","load_balancing_strategy":"primary","db_duration_s":0.001035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1663gitlab # [ 184.788307] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8aaa5d5da4a8247ce0c21c52","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8aaa5d5da4a8247ce0c21c52: start","job_status":"start","queue_duration_s":0.786315,"scheduling_latency_s":0.786329}1664gitlab # [ 184.800285] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8aaa5d5da4a8247ce0c21c52","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8aaa5d5da4a8247ce0c21c52: done: 0.010965 sec","job_status":"done","queue_duration_s":0.786315,"scheduling_latency_s":0.786329,"redis_calls":10,"redis_duration_s":0.001448,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000804,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010965,"completed_at":"2026-09-03T10:16:03.262Z","load_balancing_strategy":"primary","db_duration_s":0.001028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1665gitlab # [ 184.846786] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"eeb4eaebb48f7df3c63dd71b","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-eeb4eaebb48f7df3c63dd71b: start","job_status":"start","queue_duration_s":0.798165,"scheduling_latency_s":0.798178}1666gitlab # [ 184.847817] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"eeb4eaebb48f7df3c63dd71b","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-eeb4eaebb48f7df3c63dd71b: done: 0.023271 sec","job_status":"done","queue_duration_s":0.798165,"scheduling_latency_s":0.798178,"redis_calls":10,"redis_duration_s":0.009055,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00265,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.006405,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023271,"completed_at":"2026-09-03T10:16:03.286Z","load_balancing_strategy":"primary","db_duration_s":0.007342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667gitlab # [ 184.894891] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e9e8f590ccded70a2251e39e","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e9e8f590ccded70a2251e39e: start","job_status":"start","queue_duration_s":0.824005,"scheduling_latency_s":0.824021}1668gitlab # [ 184.895802] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e9e8f590ccded70a2251e39e","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e9e8f590ccded70a2251e39e: done: 0.020354 sec","job_status":"done","queue_duration_s":0.824005,"scheduling_latency_s":0.824021,"redis_calls":10,"redis_duration_s":0.007085,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00413,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020354,"completed_at":"2026-09-03T10:16:03.309Z","load_balancing_strategy":"primary","db_duration_s":0.004324,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1669gitlab # [ 184.939469] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a8f43ec1dacf0f2515833606","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a8f43ec1dacf0f2515833606: start","job_status":"start","queue_duration_s":0.846953,"scheduling_latency_s":0.846969}1670gitlab # [ 184.940785] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a8f43ec1dacf0f2515833606","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a8f43ec1dacf0f2515833606: done: 0.012158 sec","job_status":"done","queue_duration_s":0.846953,"scheduling_latency_s":0.846969,"redis_calls":10,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000857,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012158,"completed_at":"2026-09-03T10:16:03.324Z","load_balancing_strategy":"primary","db_duration_s":0.001134,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1671gitlab # [ 184.994362] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e347cce0277d6e28a81d902c","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e347cce0277d6e28a81d902c: start","job_status":"start","queue_duration_s":0.860045,"scheduling_latency_s":0.860058}1672gitlab # [ 184.995373] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e347cce0277d6e28a81d902c","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e347cce0277d6e28a81d902c: done: 0.010913 sec","job_status":"done","queue_duration_s":0.860045,"scheduling_latency_s":0.860058,"redis_calls":10,"redis_duration_s":0.001367,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000802,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010913,"completed_at":"2026-09-03T10:16:03.336Z","load_balancing_strategy":"primary","db_duration_s":0.001078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1673gitlab # [ 185.036761] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"18e905a811f8b6c68d6cc4ed","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-18e905a811f8b6c68d6cc4ed: start","job_status":"start","queue_duration_s":0.871827,"scheduling_latency_s":0.87184}1674gitlab # [ 185.037763] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"18e905a811f8b6c68d6cc4ed","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-18e905a811f8b6c68d6cc4ed: done: 0.011558 sec","job_status":"done","queue_duration_s":0.871827,"scheduling_latency_s":0.87184,"redis_calls":10,"redis_duration_s":0.001433,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000835,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011558,"completed_at":"2026-09-03T10:16:03.348Z","load_balancing_strategy":"primary","db_duration_s":0.001078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1675gitlab # [ 185.088339] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"86bb21bc907bb9cb18282a66","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-86bb21bc907bb9cb18282a66: start","job_status":"start","queue_duration_s":0.884248,"scheduling_latency_s":0.884261}1676gitlab # [ 185.089262] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"86bb21bc907bb9cb18282a66","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-86bb21bc907bb9cb18282a66: done: 0.017268 sec","job_status":"done","queue_duration_s":0.884248,"scheduling_latency_s":0.884261,"redis_calls":10,"redis_duration_s":0.004431,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003863,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017268,"completed_at":"2026-09-03T10:16:03.366Z","load_balancing_strategy":"primary","db_duration_s":0.004126,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1677gitlab # [ 185.130471] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8f0c1f0522157e2657dbf6ba","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8f0c1f0522157e2657dbf6ba: start","job_status":"start","queue_duration_s":0.902643,"scheduling_latency_s":0.902658}1678gitlab # [ 185.131394] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8f0c1f0522157e2657dbf6ba","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8f0c1f0522157e2657dbf6ba: done: 0.015061 sec","job_status":"done","queue_duration_s":0.902643,"scheduling_latency_s":0.902658,"redis_calls":10,"redis_duration_s":0.001579,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00084,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015061,"completed_at":"2026-09-03T10:16:03.382Z","load_balancing_strategy":"primary","db_duration_s":0.004678,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1679gitlab # [ 185.183998] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"241171d30725450f3d3614fb","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-241171d30725450f3d3614fb: start","job_status":"start","queue_duration_s":0.918851,"scheduling_latency_s":0.918865}1680gitlab # [ 185.185056] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"241171d30725450f3d3614fb","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-241171d30725450f3d3614fb: done: 0.011574 sec","job_status":"done","queue_duration_s":0.918851,"scheduling_latency_s":0.918865,"redis_calls":10,"redis_duration_s":0.001335,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000836,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011574,"completed_at":"2026-09-03T10:16:03.395Z","load_balancing_strategy":"primary","db_duration_s":0.001086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1681gitlab # [ 185.203690] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7c44b806cc896233fe539357","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7c44b806cc896233fe539357: start","job_status":"start","queue_duration_s":0.931476,"scheduling_latency_s":0.931489}1682gitlab # [ 185.253209] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7c44b806cc896233fe539357","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7c44b806cc896233fe539357: done: 0.011775 sec","job_status":"done","queue_duration_s":0.931476,"scheduling_latency_s":0.931489,"redis_calls":10,"redis_duration_s":0.001442,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011775,"completed_at":"2026-09-03T10:16:03.408Z","load_balancing_strategy":"primary","db_duration_s":0.001131,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1683gitlab # [ 185.254758] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cc2a6051cfeb3e1c0dc00ef0","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cc2a6051cfeb3e1c0dc00ef0: start","job_status":"start","queue_duration_s":0.94415,"scheduling_latency_s":0.944164}1684gitlab # [ 185.297124] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cc2a6051cfeb3e1c0dc00ef0","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cc2a6051cfeb3e1c0dc00ef0: done: 0.011663 sec","job_status":"done","queue_duration_s":0.94415,"scheduling_latency_s":0.944164,"redis_calls":10,"redis_duration_s":0.0013839999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000841,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011663,"completed_at":"2026-09-03T10:16:03.420Z","load_balancing_strategy":"primary","db_duration_s":0.001034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1685gitlab # [ 185.298406] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"99b8991ea912ede59d9a9cb1","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-99b8991ea912ede59d9a9cb1: start","job_status":"start","queue_duration_s":0.956718,"scheduling_latency_s":0.956752}1686gitlab # [ 185.306589] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"99b8991ea912ede59d9a9cb1","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-99b8991ea912ede59d9a9cb1: done: 0.016085 sec","job_status":"done","queue_duration_s":0.956718,"scheduling_latency_s":0.956752,"redis_calls":10,"redis_duration_s":0.0015440000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016085,"completed_at":"2026-09-03T10:16:03.437Z","load_balancing_strategy":"primary","db_duration_s":0.005207,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1687gitlab # [ 185.347682] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"81125bca200d5c7b34828bfb","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-81125bca200d5c7b34828bfb: start","job_status":"start","queue_duration_s":0.973671,"scheduling_latency_s":0.973685}1688gitlab # [ 185.351921] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"81125bca200d5c7b34828bfb","created_at":"2026-09-03T10:16:02.380Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-62f6946de68d46a1","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"99bcca68f743a862a39d3f5bea3a336f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.465Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-81125bca200d5c7b34828bfb: done: 0.012387 sec","job_status":"done","queue_duration_s":0.973671,"scheduling_latency_s":0.973685,"redis_calls":10,"redis_duration_s":0.00133,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000777,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012387,"completed_at":"2026-09-03T10:16:03.451Z","load_balancing_strategy":"primary","db_duration_s":0.001071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1689gitlab # [ 185.410529] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"638b29e153f0d0b8f1e8d9d3","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-638b29e153f0d0b8f1e8d9d3: start","job_status":"start","queue_duration_s":0.879088,"scheduling_latency_s":0.879102}1690gitlab # [ 185.411137] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"638b29e153f0d0b8f1e8d9d3","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-638b29e153f0d0b8f1e8d9d3: done: 0.010477 sec","job_status":"done","queue_duration_s":0.879088,"scheduling_latency_s":0.879102,"redis_calls":13,"redis_duration_s":0.001537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010477,"completed_at":"2026-09-03T10:16:03.462Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1691gitlab # [ 185.458617] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3aa034db22ea89221484a3ac","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3aa034db22ea89221484a3ac: start","job_status":"start","queue_duration_s":0.890829,"scheduling_latency_s":0.890844}1692gitlab # [ 185.459246] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3aa034db22ea89221484a3ac","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3aa034db22ea89221484a3ac: done: 0.010244 sec","job_status":"done","queue_duration_s":0.890829,"scheduling_latency_s":0.890844,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010244,"completed_at":"2026-09-03T10:16:03.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693gitlab # [ 185.519430] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27f6a6302522b5553f78bbaa","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27f6a6302522b5553f78bbaa: start","job_status":"start","queue_duration_s":0.902301,"scheduling_latency_s":0.902314}1694gitlab # [ 185.520716] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27f6a6302522b5553f78bbaa","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27f6a6302522b5553f78bbaa: done: 0.010454 sec","job_status":"done","queue_duration_s":0.902301,"scheduling_latency_s":0.902314,"redis_calls":13,"redis_duration_s":0.0017399999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010454,"completed_at":"2026-09-03T10:16:03.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1695gitlab # [ 185.561729] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95b8fa9b4de5be5542f80202","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95b8fa9b4de5be5542f80202: start","job_status":"start","queue_duration_s":0.913916,"scheduling_latency_s":0.913929}1696gitlab # [ 185.562653] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95b8fa9b4de5be5542f80202","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95b8fa9b4de5be5542f80202: done: 0.009798 sec","job_status":"done","queue_duration_s":0.913916,"scheduling_latency_s":0.913929,"redis_calls":13,"redis_duration_s":0.00157,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009798,"completed_at":"2026-09-03T10:16:03.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1697gitlab # [ 185.604817] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2af0be2c784710a145f79149","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2af0be2c784710a145f79149: start","job_status":"start","queue_duration_s":0.92462,"scheduling_latency_s":0.924633}1698gitlab # [ 185.605779] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2af0be2c784710a145f79149","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2af0be2c784710a145f79149: done: 0.008987 sec","job_status":"done","queue_duration_s":0.92462,"scheduling_latency_s":0.924633,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008987,"completed_at":"2026-09-03T10:16:03.506Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699gitlab # [ 185.654857] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a763e433b9ccf2088bbcb3bf","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a763e433b9ccf2088bbcb3bf: start","job_status":"start","queue_duration_s":0.934442,"scheduling_latency_s":0.934455}1700gitlab # [ 185.655957] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a763e433b9ccf2088bbcb3bf","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a763e433b9ccf2088bbcb3bf: done: 0.009091 sec","job_status":"done","queue_duration_s":0.934442,"scheduling_latency_s":0.934455,"redis_calls":13,"redis_duration_s":0.0015199999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009091,"completed_at":"2026-09-03T10:16:03.516Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1701gitlab # [ 185.670071] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"685c36512309358228ad6043","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-685c36512309358228ad6043: start","job_status":"start","queue_duration_s":0.944398,"scheduling_latency_s":0.944412}1702gitlab # [ 185.717924] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"685c36512309358228ad6043","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-685c36512309358228ad6043: done: 0.009163 sec","job_status":"done","queue_duration_s":0.944398,"scheduling_latency_s":0.944412,"redis_calls":13,"redis_duration_s":0.0016090000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009163,"completed_at":"2026-09-03T10:16:03.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1703gitlab # [ 185.719622] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57066b1cec208bcccd1b53f2","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57066b1cec208bcccd1b53f2: start","job_status":"start","queue_duration_s":0.954418,"scheduling_latency_s":0.954432}1704gitlab # [ 185.730189] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57066b1cec208bcccd1b53f2","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57066b1cec208bcccd1b53f2: done: 0.00908 sec","job_status":"done","queue_duration_s":0.954418,"scheduling_latency_s":0.954432,"redis_calls":13,"redis_duration_s":0.001518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00908,"completed_at":"2026-09-03T10:16:03.536Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1705gitlab # [ 185.777321] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90ceff01b5418e6079c3b278","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90ceff01b5418e6079c3b278: start","job_status":"start","queue_duration_s":0.964379,"scheduling_latency_s":0.964393}1706gitlab # [ 185.779898] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90ceff01b5418e6079c3b278","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90ceff01b5418e6079c3b278: done: 0.009031 sec","job_status":"done","queue_duration_s":0.964379,"scheduling_latency_s":0.964393,"redis_calls":13,"redis_duration_s":0.001565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009031,"completed_at":"2026-09-03T10:16:03.546Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1707gitlab # [ 185.848926] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d81f035fa57c2b20c466033d","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d81f035fa57c2b20c466033d: start","job_status":"start","queue_duration_s":0.974274,"scheduling_latency_s":0.974288}1708gitlab # [ 185.849746] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d81f035fa57c2b20c466033d","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d81f035fa57c2b20c466033d: done: 0.00898 sec","job_status":"done","queue_duration_s":0.974274,"scheduling_latency_s":0.974288,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00898,"completed_at":"2026-09-03T10:16:03.556Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1709gitlab # [ 185.863188] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5cbc1bc5c8b617449f5479d","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5cbc1bc5c8b617449f5479d: start","job_status":"start","queue_duration_s":0.984164,"scheduling_latency_s":0.984178}1710gitlab # [ 185.909897] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5cbc1bc5c8b617449f5479d","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5cbc1bc5c8b617449f5479d: done: 0.009364 sec","job_status":"done","queue_duration_s":0.984164,"scheduling_latency_s":0.984178,"redis_calls":13,"redis_duration_s":0.001807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009364,"completed_at":"2026-09-03T10:16:03.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1711gitlab # [ 185.911646] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c51cbc7e6cac20328411062","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c51cbc7e6cac20328411062: start","job_status":"start","queue_duration_s":0.994455,"scheduling_latency_s":0.994468}1712gitlab # [ 185.951680] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c51cbc7e6cac20328411062","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c51cbc7e6cac20328411062: done: 0.00927 sec","job_status":"done","queue_duration_s":0.994455,"scheduling_latency_s":0.994468,"redis_calls":13,"redis_duration_s":0.001709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00927,"completed_at":"2026-09-03T10:16:03.576Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1713gitlab # [ 185.957142] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f3ee4c5d6e489da211bbe04","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f3ee4c5d6e489da211bbe04: start","job_status":"start","queue_duration_s":1.004814,"scheduling_latency_s":1.004827}1714gitlab # [ 186.002519] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f3ee4c5d6e489da211bbe04","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f3ee4c5d6e489da211bbe04: done: 0.018356 sec","job_status":"done","queue_duration_s":1.004814,"scheduling_latency_s":1.004827,"redis_calls":13,"redis_duration_s":0.01027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018356,"completed_at":"2026-09-03T10:16:03.596Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1715gitlab # [ 186.005298] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5128a63f95cff59e385f2c53","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5128a63f95cff59e385f2c53: start","job_status":"start","queue_duration_s":1.024137,"scheduling_latency_s":1.02415}1716gitlab # [ 186.049959] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5128a63f95cff59e385f2c53","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5128a63f95cff59e385f2c53: done: 0.009385 sec","job_status":"done","queue_duration_s":1.024137,"scheduling_latency_s":1.02415,"redis_calls":13,"redis_duration_s":0.001739,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001196,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009385,"completed_at":"2026-09-03T10:16:03.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1717gitlab # [ 186.090791] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fdc87fb4969195341972f37","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fdc87fb4969195341972f37: start","job_status":"start","queue_duration_s":1.034455,"scheduling_latency_s":1.034468}1718gitlab # [ 186.091811] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fdc87fb4969195341972f37","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fdc87fb4969195341972f37: done: 0.009695 sec","job_status":"done","queue_duration_s":1.034455,"scheduling_latency_s":1.034468,"redis_calls":13,"redis_duration_s":0.002221,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001499,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009695,"completed_at":"2026-09-03T10:16:03.617Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1719gitlab # [ 186.136550] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"572fba0465c9dbe9ffedfcaf","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-572fba0465c9dbe9ffedfcaf: start","job_status":"start","queue_duration_s":1.045238,"scheduling_latency_s":1.045251}1720gitlab # [ 186.137435] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"572fba0465c9dbe9ffedfcaf","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-572fba0465c9dbe9ffedfcaf: done: 0.009807 sec","job_status":"done","queue_duration_s":1.045238,"scheduling_latency_s":1.045251,"redis_calls":13,"redis_duration_s":0.0023439999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001581,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009807,"completed_at":"2026-09-03T10:16:03.627Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1721gitlab # [ 186.147080] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce85c7e9db8273afeada9f83","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce85c7e9db8273afeada9f83: start","job_status":"start","queue_duration_s":1.05612,"scheduling_latency_s":1.056134}1722gitlab # [ 186.194806] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce85c7e9db8273afeada9f83","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce85c7e9db8273afeada9f83: done: 0.014043 sec","job_status":"done","queue_duration_s":1.05612,"scheduling_latency_s":1.056134,"redis_calls":13,"redis_duration_s":0.006243,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002247,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014043,"completed_at":"2026-09-03T10:16:03.643Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1723gitlab # [ 186.196211] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56971f0a90d096425c246879","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56971f0a90d096425c246879: start","job_status":"start","queue_duration_s":1.071268,"scheduling_latency_s":1.071282}1724gitlab # [ 186.206161] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56971f0a90d096425c246879","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56971f0a90d096425c246879: done: 0.010507 sec","job_status":"done","queue_duration_s":1.071268,"scheduling_latency_s":1.071282,"redis_calls":13,"redis_duration_s":0.002809,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001726,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010507,"completed_at":"2026-09-03T10:16:03.654Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1725gitlab # [ 186.262873] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0c2574686d2de897aecad8e","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0c2574686d2de897aecad8e: start","job_status":"start","queue_duration_s":1.08284,"scheduling_latency_s":1.082853}1726gitlab # [ 186.263717] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0c2574686d2de897aecad8e","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0c2574686d2de897aecad8e: done: 0.009954 sec","job_status":"done","queue_duration_s":1.08284,"scheduling_latency_s":1.082853,"redis_calls":13,"redis_duration_s":0.002382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001648,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009954,"completed_at":"2026-09-03T10:16:03.665Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1727gitlab # [ 186.310813] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65fa070db6c6c100e225f132","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65fa070db6c6c100e225f132: start","job_status":"start","queue_duration_s":1.093884,"scheduling_latency_s":1.093898}1728gitlab # [ 186.311944] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65fa070db6c6c100e225f132","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65fa070db6c6c100e225f132: done: 0.017704 sec","job_status":"done","queue_duration_s":1.093884,"scheduling_latency_s":1.093898,"redis_calls":13,"redis_duration_s":0.009571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005612,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017704,"completed_at":"2026-09-03T10:16:03.684Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1729gitlab # [ 186.353741] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"350919cf9656cf94bffe22a4","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-350919cf9656cf94bffe22a4: start","job_status":"start","queue_duration_s":1.114144,"scheduling_latency_s":1.114158}1730gitlab # [ 186.354787] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"350919cf9656cf94bffe22a4","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-350919cf9656cf94bffe22a4: done: 0.01726 sec","job_status":"done","queue_duration_s":1.114144,"scheduling_latency_s":1.114158,"redis_calls":13,"redis_duration_s":0.008474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006446,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01726,"completed_at":"2026-09-03T10:16:03.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1731gitlab # [ 186.399997] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c6f1c2e2dec4d7a8d9d601b","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c6f1c2e2dec4d7a8d9d601b: start","job_status":"start","queue_duration_s":1.134124,"scheduling_latency_s":1.134138}1732gitlab # [ 186.400967] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c6f1c2e2dec4d7a8d9d601b","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c6f1c2e2dec4d7a8d9d601b: done: 0.014023 sec","job_status":"done","queue_duration_s":1.134124,"scheduling_latency_s":1.134138,"redis_calls":13,"redis_duration_s":0.005318,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001186,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014023,"completed_at":"2026-09-03T10:16:03.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1733gitlab # [ 186.457136] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28cfe6a3c44c6d02d5cc2cab","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28cfe6a3c44c6d02d5cc2cab: start","job_status":"start","queue_duration_s":1.149066,"scheduling_latency_s":1.149081}1734gitlab # [ 186.457956] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28cfe6a3c44c6d02d5cc2cab","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28cfe6a3c44c6d02d5cc2cab: done: 0.009109 sec","job_status":"done","queue_duration_s":1.149066,"scheduling_latency_s":1.149081,"redis_calls":13,"redis_duration_s":0.0016940000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009109,"completed_at":"2026-09-03T10:16:03.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1735gitlab # [ 186.512349] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59edbd54e8569354eb278454","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59edbd54e8569354eb278454: start","job_status":"start","queue_duration_s":1.159053,"scheduling_latency_s":1.159066}1736gitlab # [ 186.513072] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59edbd54e8569354eb278454","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59edbd54e8569354eb278454: done: 0.009088 sec","job_status":"done","queue_duration_s":1.159053,"scheduling_latency_s":1.159066,"redis_calls":13,"redis_duration_s":0.001662,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009088,"completed_at":"2026-09-03T10:16:03.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1737gitlab # [ 186.525687] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ff37b833755cbf7d63f7fd1","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ff37b833755cbf7d63f7fd1: start","job_status":"start","queue_duration_s":1.169044,"scheduling_latency_s":1.169057}1738gitlab # [ 186.568295] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ff37b833755cbf7d63f7fd1","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ff37b833755cbf7d63f7fd1: done: 0.009192 sec","job_status":"done","queue_duration_s":1.169044,"scheduling_latency_s":1.169057,"redis_calls":13,"redis_duration_s":0.0017330000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000597,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009192,"completed_at":"2026-09-03T10:16:03.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1739gitlab # [ 186.610843] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d90e5409a963eb9cb4bed6f","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d90e5409a963eb9cb4bed6f: start","job_status":"start","queue_duration_s":1.17913,"scheduling_latency_s":1.179142}1740gitlab # [ 186.611815] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d90e5409a963eb9cb4bed6f","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d90e5409a963eb9cb4bed6f: done: 0.018407 sec","job_status":"done","queue_duration_s":1.17913,"scheduling_latency_s":1.179142,"redis_calls":13,"redis_duration_s":0.010615,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001334,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009281,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018407,"completed_at":"2026-09-03T10:16:03.770Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1741gitlab # [ 186.619554] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37627302b0a0868bf86f7c18","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37627302b0a0868bf86f7c18: start","job_status":"start","queue_duration_s":1.198608,"scheduling_latency_s":1.198622}1742gitlab # [ 186.631729] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37627302b0a0868bf86f7c18","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37627302b0a0868bf86f7c18: done: 0.009218 sec","job_status":"done","queue_duration_s":1.198608,"scheduling_latency_s":1.198622,"redis_calls":13,"redis_duration_s":0.0016920000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009218,"completed_at":"2026-09-03T10:16:03.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1743gitlab # [ 186.684849] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a39d072070ebac123bb04f3f","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a39d072070ebac123bb04f3f: start","job_status":"start","queue_duration_s":1.208705,"scheduling_latency_s":1.208718}1744gitlab # [ 186.685832] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a39d072070ebac123bb04f3f","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a39d072070ebac123bb04f3f: done: 0.009379 sec","job_status":"done","queue_duration_s":1.208705,"scheduling_latency_s":1.208718,"redis_calls":13,"redis_duration_s":0.00195,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009379,"completed_at":"2026-09-03T10:16:03.790Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1745gitlab # [ 186.730838] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff6cf0b2721d4351b794a771","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff6cf0b2721d4351b794a771: start","job_status":"start","queue_duration_s":1.219025,"scheduling_latency_s":1.219038}1746gitlab # [ 186.731908] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff6cf0b2721d4351b794a771","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff6cf0b2721d4351b794a771: done: 0.009194 sec","job_status":"done","queue_duration_s":1.219025,"scheduling_latency_s":1.219038,"redis_calls":13,"redis_duration_s":0.001688,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009194,"completed_at":"2026-09-03T10:16:03.801Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1747gitlab # [ 186.773070] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb3b86481c31ed61dfd53eb5","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb3b86481c31ed61dfd53eb5: start","job_status":"start","queue_duration_s":1.229124,"scheduling_latency_s":1.229138}1748gitlab # [ 186.774247] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb3b86481c31ed61dfd53eb5","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb3b86481c31ed61dfd53eb5: done: 0.009099 sec","job_status":"done","queue_duration_s":1.229124,"scheduling_latency_s":1.229138,"redis_calls":13,"redis_duration_s":0.001712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009099,"completed_at":"2026-09-03T10:16:03.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1749gitlab # [ 186.836752] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"379592b07e6bfd7b3727c574","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-379592b07e6bfd7b3727c574: start","job_status":"start","queue_duration_s":1.243078,"scheduling_latency_s":1.243093}1750gitlab # [ 186.837691] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"379592b07e6bfd7b3727c574","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-379592b07e6bfd7b3727c574: done: 0.009314 sec","job_status":"done","queue_duration_s":1.243078,"scheduling_latency_s":1.243093,"redis_calls":13,"redis_duration_s":0.0017130000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009314,"completed_at":"2026-09-03T10:16:03.825Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1751gitlab # [ 186.883876] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6121a3d213c19bb5058b151","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6121a3d213c19bb5058b151: start","job_status":"start","queue_duration_s":1.253332,"scheduling_latency_s":1.253345}1752gitlab # [ 186.884916] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6121a3d213c19bb5058b151","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6121a3d213c19bb5058b151: done: 0.009193 sec","job_status":"done","queue_duration_s":1.253332,"scheduling_latency_s":1.253345,"redis_calls":13,"redis_duration_s":0.001719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009193,"completed_at":"2026-09-03T10:16:03.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1753gitlab # [ 186.935908] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c168bf152629f450aeb1b71d","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c168bf152629f450aeb1b71d: start","job_status":"start","queue_duration_s":1.263427,"scheduling_latency_s":1.26344}1754gitlab # [ 186.936617] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c168bf152629f450aeb1b71d","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c168bf152629f450aeb1b71d: done: 0.009354 sec","job_status":"done","queue_duration_s":1.263427,"scheduling_latency_s":1.26344,"redis_calls":13,"redis_duration_s":0.001948,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001297,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009354,"completed_at":"2026-09-03T10:16:03.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1755gitlab # [ 186.982436] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"323a3ec7b87c385e3a6d5a80","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-323a3ec7b87c385e3a6d5a80: start","job_status":"start","queue_duration_s":1.273883,"scheduling_latency_s":1.273896}1756gitlab # [ 186.984257] postgres[2453]: [2453] ERROR: relation "table_without_models" does not exist1757gitlab # [ 186.985186] postgres[2453]: [2453] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1758gitlab # [ 186.986064] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"323a3ec7b87c385e3a6d5a80","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-323a3ec7b87c385e3a6d5a80: done: 0.009913 sec","job_status":"done","queue_duration_s":1.273883,"scheduling_latency_s":1.273896,"redis_calls":13,"redis_duration_s":0.002423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001682,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009913,"completed_at":"2026-09-03T10:16:03.856Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1759gitlab # [ 187.030239] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be8b5d395fc74e4381448f5b","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be8b5d395fc74e4381448f5b: start","job_status":"start","queue_duration_s":1.288146,"scheduling_latency_s":1.288159}1760gitlab # [ 187.031219] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be8b5d395fc74e4381448f5b","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be8b5d395fc74e4381448f5b: done: 0.01209 sec","job_status":"done","queue_duration_s":1.288146,"scheduling_latency_s":1.288159,"redis_calls":13,"redis_duration_s":0.003197,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001713,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001484,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01209,"completed_at":"2026-09-03T10:16:03.873Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1761gitlab # [ 187.071398] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c197517557f85a47617248c","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c197517557f85a47617248c: start","job_status":"start","queue_duration_s":1.301202,"scheduling_latency_s":1.301217}1762gitlab # [ 187.072442] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c197517557f85a47617248c","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c197517557f85a47617248c: done: 0.009297 sec","job_status":"done","queue_duration_s":1.301202,"scheduling_latency_s":1.301217,"redis_calls":13,"redis_duration_s":0.0016820000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009297,"completed_at":"2026-09-03T10:16:03.883Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1763gitlab # [ 187.115785] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55f5fed739105d9a4e810939","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55f5fed739105d9a4e810939: start","job_status":"start","queue_duration_s":1.31141,"scheduling_latency_s":1.311424}1764gitlab # [ 187.117176] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55f5fed739105d9a4e810939","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55f5fed739105d9a4e810939: done: 0.009884 sec","job_status":"done","queue_duration_s":1.31141,"scheduling_latency_s":1.311424,"redis_calls":13,"redis_duration_s":0.002098,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001375,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009884,"completed_at":"2026-09-03T10:16:03.894Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1765gitlab # [ 187.172647] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d09893890662a3acd8d668e6","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d09893890662a3acd8d668e6: start","job_status":"start","queue_duration_s":1.322353,"scheduling_latency_s":1.322367}1766gitlab # [ 187.173642] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d09893890662a3acd8d668e6","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d09893890662a3acd8d668e6: done: 0.010358 sec","job_status":"done","queue_duration_s":1.322353,"scheduling_latency_s":1.322367,"redis_calls":13,"redis_duration_s":0.002424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001702,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010358,"completed_at":"2026-09-03T10:16:03.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1767gitlab # [ 187.223304] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4002a998cdd7958eabb044e9","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4002a998cdd7958eabb044e9: start","job_status":"start","queue_duration_s":1.333959,"scheduling_latency_s":1.333972}1768gitlab # [ 187.224518] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4002a998cdd7958eabb044e9","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4002a998cdd7958eabb044e9: done: 0.018414 sec","job_status":"done","queue_duration_s":1.333959,"scheduling_latency_s":1.333972,"redis_calls":13,"redis_duration_s":0.006764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018414,"completed_at":"2026-09-03T10:16:03.925Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1769gitlab # [ 187.269301] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce8c1a146bf7a9a9b90564d5","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce8c1a146bf7a9a9b90564d5: start","job_status":"start","queue_duration_s":1.353469,"scheduling_latency_s":1.353484}1770gitlab # [ 187.270303] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce8c1a146bf7a9a9b90564d5","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce8c1a146bf7a9a9b90564d5: done: 0.00968 sec","job_status":"done","queue_duration_s":1.353469,"scheduling_latency_s":1.353484,"redis_calls":13,"redis_duration_s":0.0017040000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00968,"completed_at":"2026-09-03T10:16:03.936Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1771gitlab # [ 187.318439] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47b0d9f3c6b4309c1afbf0c2","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47b0d9f3c6b4309c1afbf0c2: start","job_status":"start","queue_duration_s":1.364038,"scheduling_latency_s":1.364051}1772gitlab # [ 187.319340] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47b0d9f3c6b4309c1afbf0c2","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47b0d9f3c6b4309c1afbf0c2: done: 0.010401 sec","job_status":"done","queue_duration_s":1.364038,"scheduling_latency_s":1.364051,"redis_calls":13,"redis_duration_s":0.0024879999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010401,"completed_at":"2026-09-03T10:16:03.947Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1773gitlab # [ 187.365106] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78c4b3e8fa7a19a78737e6c5","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78c4b3e8fa7a19a78737e6c5: start","job_status":"start","queue_duration_s":1.375476,"scheduling_latency_s":1.375489}1774gitlab # [ 187.366075] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78c4b3e8fa7a19a78737e6c5","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78c4b3e8fa7a19a78737e6c5: done: 0.01048 sec","job_status":"done","queue_duration_s":1.375476,"scheduling_latency_s":1.375489,"redis_calls":13,"redis_duration_s":0.002384,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01048,"completed_at":"2026-09-03T10:16:03.958Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1775gitlab # [ 187.376066] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2f30c8c77c0b36716ca07f6","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2f30c8c77c0b36716ca07f6: start","job_status":"start","queue_duration_s":1.386999,"scheduling_latency_s":1.387012}1776gitlab # [ 187.421254] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2f30c8c77c0b36716ca07f6","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2f30c8c77c0b36716ca07f6: done: 0.020571 sec","job_status":"done","queue_duration_s":1.386999,"scheduling_latency_s":1.387012,"redis_calls":13,"redis_duration_s":0.009394,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002322,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020571,"completed_at":"2026-09-03T10:16:03.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1777gitlab # [ 187.422755] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"184da12fa34ef07c214765b6","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-184da12fa34ef07c214765b6: start","job_status":"start","queue_duration_s":1.411134,"scheduling_latency_s":1.41115}1778gitlab # [ 187.434875] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"184da12fa34ef07c214765b6","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-184da12fa34ef07c214765b6: done: 0.010487 sec","job_status":"done","queue_duration_s":1.411134,"scheduling_latency_s":1.41115,"redis_calls":13,"redis_duration_s":0.001765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010487,"completed_at":"2026-09-03T10:16:03.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1779gitlab # [ 187.480108] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:03.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1f8217adb04ad96bacceb43","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1f8217adb04ad96bacceb43: start","job_status":"start","queue_duration_s":1.42252,"scheduling_latency_s":1.422534}1780gitlab # [ 187.481822] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:04.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1f8217adb04ad96bacceb43","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1f8217adb04ad96bacceb43: done: 0.009759 sec","job_status":"done","queue_duration_s":1.42252,"scheduling_latency_s":1.422534,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009759,"completed_at":"2026-09-03T10:16:04.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1781gitlab # [ 187.523927] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:04.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7ba1e261238971a000a6459","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7ba1e261238971a000a6459: start","job_status":"start","queue_duration_s":1.433178,"scheduling_latency_s":1.433191}1782gitlab # [ 187.528692] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:04.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7ba1e261238971a000a6459","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7ba1e261238971a000a6459: done: 0.009457 sec","job_status":"done","queue_duration_s":1.433178,"scheduling_latency_s":1.433191,"redis_calls":13,"redis_duration_s":0.001665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009457,"completed_at":"2026-09-03T10:16:04.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1783gitlab # [ 187.571289] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:04.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dccf94d7ff10cf9da4d71d0","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dccf94d7ff10cf9da4d71d0: start","job_status":"start","queue_duration_s":1.44366,"scheduling_latency_s":1.443673}1784gitlab # [ 187.575675] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:04.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dccf94d7ff10cf9da4d71d0","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dccf94d7ff10cf9da4d71d0: done: 0.013896 sec","job_status":"done","queue_duration_s":1.44366,"scheduling_latency_s":1.443673,"redis_calls":13,"redis_duration_s":0.005705,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013896,"completed_at":"2026-09-03T10:16:04.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1785gitlab # [ 187.614084] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:04.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43f9aef80aa90d30aa0b9e26","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43f9aef80aa90d30aa0b9e26: start","job_status":"start","queue_duration_s":1.458743,"scheduling_latency_s":1.458756}1786gitlab # [ 187.661099] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:04.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43f9aef80aa90d30aa0b9e26","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43f9aef80aa90d30aa0b9e26: done: 0.010427 sec","job_status":"done","queue_duration_s":1.458743,"scheduling_latency_s":1.458756,"redis_calls":13,"redis_duration_s":0.0023569999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001597,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010427,"completed_at":"2026-09-03T10:16:04.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1787gitlab # [ 187.662757] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:04.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a618ca7421232ef8736c3926","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a618ca7421232ef8736c3926: start","job_status":"start","queue_duration_s":1.470319,"scheduling_latency_s":1.470332}1788gitlab # [ 187.707564] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:04.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a618ca7421232ef8736c3926","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a618ca7421232ef8736c3926: done: 0.010467 sec","job_status":"done","queue_duration_s":1.470319,"scheduling_latency_s":1.470332,"redis_calls":13,"redis_duration_s":0.002412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001723,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010467,"completed_at":"2026-09-03T10:16:04.053Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1789gitlab # [ 187.709165] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:04.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8033a128242431572912f48f","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8033a128242431572912f48f: start","job_status":"start","queue_duration_s":1.481996,"scheduling_latency_s":1.482011}1790gitlab # [ 187.719908] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:04.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8033a128242431572912f48f","created_at":"2026-09-03T10:16:02.526Z","trace_propagation_headers":{"sentry-trace":"e3c5cd02cc4949918a37818d10008365-17d52518b64f435f","baggage":"sentry-trace_id=e3c5cd02cc4949918a37818d10008365,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b4f791efa0a7fc61505d4fcd5bfbd0ec","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:16:02.572Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8033a128242431572912f48f: done: 0.010694 sec","job_status":"done","queue_duration_s":1.481996,"scheduling_latency_s":1.482011,"redis_calls":13,"redis_duration_s":0.00269,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001846,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010694,"completed_at":"2026-09-03T10:16:04.065Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1791gitlab # [ 187.939811] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 4022994302 wd_nsec: 40229938371792gitlab # [ 189.827969] runuser[2245]: pam_unix(runuser:session): session closed for user gitlab1793gitlab # [ 189.828940] setup-gitlab-start[2225]: + systemctl restart gitlab-sidekiq.service1794gitlab # [ 189.855149] systemd[1]: Stopping gitlab-sidekiq.service...1795gitlab # [ 189.858209] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:10.023Z","message":"Shutting down"}1796gitlab # [ 189.859640] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:10.023Z","message":"Scheduler exiting..."}1797gitlab # [ 189.861071] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:10.024Z","message":"Terminating quiet threads for default capsule"}1798gitlab # [ 189.862729] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:10.024Z","message":"Scheduler exiting..."}1799gitlab # [ 190.360992] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:10.526Z","message":"Pausing to allow jobs to finish..."}1800gitlab # [ 194.367631] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:14.532Z","message":"Bye!"}1801gitlab # [ 194.395090] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-09-03T10:16:14.560Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1658,"worker_id":"sidekiq_0","memwd_rss_bytes":934010880,"retry":0}1802gitlab # [ 195.183864] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1803gitlab # [ 195.186416] systemd[1]: Stopped gitlab-sidekiq.service.1804gitlab # [ 195.188375] systemd[1]: gitlab-sidekiq.service: Consumed 1min 1.776s CPU time over 1min 56.550s wall clock time, 935.2M memory peak, 4.4M read from disk.1805gitlab # [ 195.192989] systemd[1]: Started gitlab-sidekiq.service.1806gitlab # [ 195.195622] setup-gitlab-start[2225]: + mkdir -p /var/lib/secrets1807gitlab # [ 195.198299] setup-gitlab-start[2225]: + echo nixbot-test-token-of-20-chars1808gitlab # [ 195.199525] setup-gitlab-start[2225]: + chmod 644 /var/lib/secrets/gitlab-token1809gitlab # [ 195.206278] setup-gitlab-start[2225]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1810gitlab # [ 195.901714] gitaly[870]: time="2026-09-03T10:16:16.066Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:16:26.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.066" pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 195.923865] gitaly[870]: time="2026-09-03T10:16:16.066Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:16:26.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.066" grpc.time_ms=0.284 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1812gitlab # [ 196.037927] gitaly[870]: time="2026-09-03T10:16:16.203Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:16:26.142" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.203" pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 196.060308] gitaly[870]: time="2026-09-03T10:16:16.203Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:16:26.142" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.203" grpc.time_ms=0.425 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 196.133377] gitaly[870]: time="2026-09-03T10:16:16.298Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR diskcache=d688a039-747a-417a-a6dd-d82785f62d5e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:16:26.152" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.213" pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 196.156124] gitaly[870]: time="2026-09-03T10:16:16.299Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1583 command.oublock=32 command.real_time_ms=44 command.spawn_token_fork_ms=23 command.system_time_ms=13 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:16:26.152" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.213" grpc.time_ms=85.603 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 196.156298] gitaly[870]: time="2026-09-03T10:16:16.313Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:16:26.252" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.313" pid=870 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1817gitlab # [ 196.158086] gitaly[870]: time="2026-09-03T10:16:16.313Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:16:26.252" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.313" grpc.time_ms=0.347 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 196.162203] gitaly[870]: time="2026-09-03T10:16:16.327Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:16:26.255" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.316" grpc.time_ms=11.114 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 196.218610] gitaly[870]: time="2026-09-03T10:16:16.384Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:16:26.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.384" pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 196.219534] gitaly[870]: time="2026-09-03T10:16:16.384Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:16:26.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.384" grpc.time_ms=0.236 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 196.261544] gitaly[870]: time="2026-09-03T10:16:16.427Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR diskcache=a597006a-a012-4722-a804-bb8a225d9df7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:16:26.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.388" pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 196.271314] gitaly[870]: time="2026-09-03T10:16:16.437Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1582 command.oublock=32 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:16:26.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.388" grpc.time_ms=39.293 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 196.278049] gitaly[870]: time="2026-09-03T10:16:16.443Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:16:26.062" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.443" pid=870 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1824gitlab # [ 196.279148] gitaly[870]: time="2026-09-03T10:16:16.444Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:16:26.062" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.443" grpc.time_ms=1.346 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1825gitlab # [ 196.290833] gitaly[870]: time="2026-09-03T10:16:16.456Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:16:26.066" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.447" grpc.time_ms=9.345 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826gitlab # [ 196.316136] gitaly[870]: time="2026-09-03T10:16:16.481Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:16:26.100" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.481" grpc.time_ms=0.197 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1827gitlab # [ 196.321294] gitaly[870]: time="2026-09-03T10:16:16.486Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-03T10:16:26.106" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.486" grpc.time_ms=0.231 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1828gitlab # [ 196.740374] gitaly[870]: time="2026-09-03T10:16:16.905Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9SS5E1XP9XGXSKW1S5PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:16:26.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:16.895" grpc.time_ms=10.673 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1829gitlab # [ 197.097921] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:17 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 18651830gitlab # [ 197.104810] setup-gitlab-start[2225]: + mkdir -p /tmp/test-flake1831gitlab # [ 197.109941] setup-gitlab-start[2225]: + cd /tmp/test-flake1832gitlab # [ 197.110077] setup-gitlab-start[2225]: + git init -b master1833gitlab # [ 197.141050] setup-gitlab-start[2544]: Initialized empty Git repository in /tmp/test-flake/.git/1834gitlab # [ 197.144021] setup-gitlab-start[2225]: + git config user.name test1835gitlab # [ 197.146875] setup-gitlab-start[2225]: + git config user.email test@example.com1836gitlab # [ 197.153295] setup-gitlab-start[2225]: + cat1837gitlab # [ 197.157852] setup-gitlab-start[2225]: + git add flake.nix1838gitlab # [ 197.161227] setup-gitlab-start[2225]: + git commit -m 'initial commit'1839gitlab # [ 197.191744] setup-gitlab-start[2549]: [master (root-commit) 0979521] initial commit1840gitlab # [ 197.192508] setup-gitlab-start[2549]: 1 file changed, 10 insertions(+)1841gitlab # [ 197.193968] setup-gitlab-start[2549]: create mode 100644 flake.nix1842gitlab # [ 197.195580] setup-gitlab-start[2225]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1843gitlab # [ 197.208750] setup-gitlab-start[2225]: + git push -u origin master1844gitlab # [ 197.313725] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:17 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 691845gitlab # [ 197.412150] gitaly[870]: time="2026-09-03T10:16:17.577Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1KC9VT8GKE218NJ1W3RBCM1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:17.565" grpc.time_ms=12.25 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1846gitlab # [ 197.413065] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:17 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 971847gitlab # [ 197.650587] gitaly[870]: time="2026-09-03T10:16:17.816Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:16:27.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:17.801" grpc.time_ms=14.295 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1848gitlab # [ 197.708834] gitaly[870]: time="2026-09-03T10:16:17.874Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-03T10:16:47.061" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-03T10:16:17.862" grpc.time_ms=12.062 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1849gitlab # [ 197.752431] gitaly[870]: time="2026-09-03T10:16:17.918Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M duration_ms=180ns method=POST pid=870 status=200 url="http://unix/api/v4/internal/allowed"1850gitlab # [ 197.788661] gitaly[870]: time="2026-09-03T10:16:17.954Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M duration_ms=30ns method=POST pid=870 status=200 url="http://unix/api/v4/internal/pre_receive"1851gitlab # [ 197.795531] gitaly[870]: time="2026-09-03T10:16:17.961Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:17.734" grpc.time_ms=226.123 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1852gitlab # [ 197.861751] gitaly[870]: time="2026-09-03T10:16:18.027Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:18.025" grpc.time_ms=1.387 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1853gitlab # [ 197.922566] gitaly[870]: time="2026-09-03T10:16:18.088Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:18.087" grpc.time_ms=0.749 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1854gitlab # [ 197.961255] gitaly[870]: time="2026-09-03T10:16:18.126Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:18.125" grpc.time_ms=1.235 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1855gitlab # [ 198.062328] gitaly[870]: time="2026-09-03T10:16:18.227Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:16:28.157" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:18.218" grpc.time_ms=9.541 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856gitlab # [ 198.112538] gitaly[870]: time="2026-09-03T10:16:18.278Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1576 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-03T10:16:28.202" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:16:18.263" grpc.time_ms=14.641 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857gitlab # [ 198.141914] gitaly[870]: time="2026-09-03T10:16:18.307Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M duration_ms=138ns method=POST pid=870 status=200 url="http://unix/api/v4/internal/post_receive"1858gitlab # [ 198.142885] gitaly[870]: time="2026-09-03T10:16:18.308Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:18.168" grpc.time_ms=140.146 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1859gitlab # [ 198.164957] gitaly[870]: time="2026-09-03T10:16:18.330Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M diskcache=5049a1ae-7279-47ac-b696-afb534bd53a7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:17.674" pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1860gitlab # [ 198.165329] gitaly[870]: time="2026-09-03T10:16:18.330Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=240 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13495 command.oublock=32 command.real_time_ms=646 command.spawn_token_fork_ms=0 command.system_time_ms=151 command.user_time_ms=89 component=gitaly.StreamServerInterceptor correlation_id=01M1KC9VYJ0SE1BJV3ASC29K0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:17.674" grpc.time_ms=656.175 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1861gitlab # [ 198.166449] gitlab-workhorse[825]: time="2026-09-03T10:16:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521862gitlab # [ 198.167127] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:18 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7131863gitlab # [ 198.190154] setup-gitlab-start[2553]: To http://gitlab/root/test-flake.git1864gitlab # [ 198.190707] setup-gitlab-start[2553]: * [new branch] master -> master1865gitlab # [ 198.195180] setup-gitlab-start[2553]: branch 'master' set up to track 'origin/master'.1866gitlab # [ 198.198322] systemd[1]: Finished setup-gitlab.service.1867gitlab # [ 198.203592] systemd[1]: Starting nixbot CI service...1868gitlab: (finished: waiting for unit setup-gitlab.service, in 199.14 seconds)1869gitlab: waiting for unit nixbot.service1870gitlab # [ 198.588820] sidekiq-cluster[2496]: {"severity":"INFO","time":"2026-09-03T10:16:18.733Z","message":"Starting cluster with 1 processes"}1871gitlab # [ 199.495950] nixbot[2630]: {"ts": "2026-09-03T10:16:19.660Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1872gitlab # [ 199.527754] nixbot[2630]: {"ts": "2026-09-03T10:16:19.693Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1873gitlab # [ 199.540603] nixbot[2630]: {"ts": "2026-09-03T10:16:19.706Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1874gitlab # [ 199.549585] nixbot[2630]: {"ts": "2026-09-03T10:16:19.715Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1875gitlab # [ 199.558223] nixbot[2630]: {"ts": "2026-09-03T10:16:19.723Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1876gitlab # [ 199.568841] nixbot[2630]: {"ts": "2026-09-03T10:16:19.734Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1877gitlab # [ 199.576813] nixbot[2630]: {"ts": "2026-09-03T10:16:19.742Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1878gitlab # [ 199.581542] nixbot[2630]: {"ts": "2026-09-03T10:16:19.746Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1879gitlab # [ 199.590940] nixbot[2630]: {"ts": "2026-09-03T10:16:19.756Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1880gitlab # [ 199.595361] nixbot[2630]: {"ts": "2026-09-03T10:16:19.758Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1881gitlab # [ 199.600899] nixbot[2630]: {"ts": "2026-09-03T10:16:19.766Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1882gitlab # [ 199.610500] nixbot[2630]: {"ts": "2026-09-03T10:16:19.776Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1883gitlab # [ 199.617237] nixbot[2630]: {"ts": "2026-09-03T10:16:19.782Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1884gitlab # [ 199.620529] nixbot[2630]: {"ts": "2026-09-03T10:16:19.786Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1885gitlab # [ 199.623862] nixbot[2630]: {"ts": "2026-09-03T10:16:19.789Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1886gitlab # [ 199.626769] nixbot[2630]: {"ts": "2026-09-03T10:16:19.792Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1887gitlab # [ 199.628515] nixbot[2630]: {"ts": "2026-09-03T10:16:19.794Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1888gitlab # [ 199.630192] nixbot[2630]: {"ts": "2026-09-03T10:16:19.795Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1889gitlab # [ 199.633970] nixbot[2630]: {"ts": "2026-09-03T10:16:19.799Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1890gitlab # [ 199.636172] nixbot[2630]: {"ts": "2026-09-03T10:16:19.801Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1891gitlab # [ 199.638924] nixbot[2630]: {"ts": "2026-09-03T10:16:19.804Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1892gitlab # [ 199.643335] nixbot[2630]: {"ts": "2026-09-03T10:16:19.808Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1893gitlab # [ 199.646370] nixbot[2630]: {"ts": "2026-09-03T10:16:19.811Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1894gitlab # [ 199.650832] nixbot[2630]: {"ts": "2026-09-03T10:16:19.816Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1895gitlab # [ 199.653279] nixbot[2630]: {"ts": "2026-09-03T10:16:19.818Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1896gitlab # [ 199.657669] nixbot[2630]: {"ts": "2026-09-03T10:16:19.823Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1897gitlab # [ 199.661960] nixbot[2630]: {"ts": "2026-09-03T10:16:19.827Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1898gitlab # [ 199.664431] nixbot[2630]: {"ts": "2026-09-03T10:16:19.830Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1899gitlab # [ 199.668272] nixbot[2630]: {"ts": "2026-09-03T10:16:19.833Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1900gitlab # [ 200.015213] nixbot[2630]: INFO: Started server process [2630]1901gitlab # [ 200.017611] nixbot[2630]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1902gitlab # [ 200.030526] nixbot[2630]: INFO: ::ffff:127.0.0.1:57162 - "GET /health HTTP/1.1" 200 OK1903gitlab # [ 200.036809] systemd[1]: Started nixbot CI service.1904gitlab # [ 200.039561] systemd[1]: Reached target Multi-User System.1905gitlab # [ 200.042786] systemd[1]: Startup finished in 1.199s (kernel) + 3.657s (initrd) + 3min 15.185s (userspace) = 3min 20.041s.1906gitlab # [ 200.234411] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:20 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1991907gitlab # [ 200.240956] nixbot[2630]: {"ts": "2026-09-03T10:16:20.406Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1908gitlab # [ 200.263021] nixbot[2630]: {"ts": "2026-09-03T10:16:20.428Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1909gitlab # [ 200.451145] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1731910gitlab # [ 200.457970] nixbot[2630]: {"ts": "2026-09-03T10:16:20.623Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1911gitlab # [ 200.466138] nixbot[2630]: {"ts": "2026-09-03T10:16:20.631Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1912gitlab # [ 200.568626] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 941913gitlab # [ 200.575331] nixbot[2630]: {"ts": "2026-09-03T10:16:20.740Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1914gitlab: (finished: waiting for unit nixbot.service, in 2.10 seconds)1915gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1916gitlab # [ 200.652742] nixbot[2630]: INFO: ::ffff:127.0.0.1:57172 - "GET /health HTTP/1.1" 200 OK1917gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1918subtest: project discovered and webhook registered1919gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1920gitlab # [ 200.747668] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 681921gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1922(finished: subtest: project discovered and webhook registered, in 0.10 seconds)1923subtest: push delivers the webhook1924gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1925gitlab # [ 200.810768] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:20 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 231926gitlab # [ 200.869384] gitaly[870]: time="2026-09-03T10:16:21.032Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KC9Z7HYFCHMST8ZN0MGRWH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:21.025" grpc.time_ms=6.858 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1927gitlab # [ 200.869690] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:21 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 561928gitlab # Enumerating objects: 5, done.1929gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1930gitlab # Delta compression using up to 4 threads1931gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1932gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1933gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1934gitlab # [ 201.100062] gitaly[870]: time="2026-09-03T10:16:21.264Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KC9ZA8NX4K9TQNFW6R21TA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-03T10:16:51.053" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-03T10:16:21.254" grpc.time_ms=9.688 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1935gitlab # [ 201.114220] gitaly[870]: time="2026-09-03T10:16:21.279Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1KC9ZA8NX4K9TQNFW6R21TA duration_ms=73ns method=POST pid=870 status=200 url="http://unix/api/v4/internal/allowed"1936gitlab # [ 201.136518] gitaly[870]: time="2026-09-03T10:16:21.302Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1KC9ZA8NX4K9TQNFW6R21TA duration_ms=19ns method=POST pid=870 status=200 url="http://unix/api/v4/internal/pre_receive"1937gitlab # [ 201.139417] gitaly[870]: time="2026-09-03T10:16:21.305Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9ZA8NX4K9TQNFW6R21TA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:21.205" grpc.time_ms=99.998 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1938gitlab # [ 201.170644] gitaly[870]: time="2026-09-03T10:16:21.336Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9ZA8NX4K9TQNFW6R21TA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:21.335" grpc.time_ms=0.396 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1939gitlab # [ 201.203833] gitaly[870]: time="2026-09-03T10:16:21.369Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9ZA8NX4K9TQNFW6R21TA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:21.369" grpc.time_ms=0.288 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1940gitlab # [ 201.234128] gitaly[870]: time="2026-09-03T10:16:21.399Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9ZA8NX4K9TQNFW6R21TA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:21.399" grpc.time_ms=0.277 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1941gitlab # [ 201.294671] gitaly[870]: time="2026-09-03T10:16:21.460Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1KC9ZA8NX4K9TQNFW6R21TA duration_ms=36ns method=POST pid=870 status=200 url="http://unix/api/v4/internal/post_receive"1942gitlab # [ 201.295540] gitaly[870]: time="2026-09-03T10:16:21.461Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9ZA8NX4K9TQNFW6R21TA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:21.423" grpc.time_ms=37.375 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1943gitlab # [ 201.316085] gitaly[870]: time="2026-09-03T10:16:21.481Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1KC9ZA8NX4K9TQNFW6R21TA diskcache=700d7de0-c1b9-4cd2-95dc-49092690d800 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:21.125" pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1944gitlab # [ 201.326031] gitaly[870]: time="2026-09-03T10:16:21.491Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=151 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13497 command.oublock=32 command.real_time_ms=347 command.spawn_token_fork_ms=0 command.system_time_ms=92 command.user_time_ms=59 component=gitaly.StreamServerInterceptor correlation_id=01M1KC9ZA8NX4K9TQNFW6R21TA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:21.125" grpc.time_ms=356.04 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1945gitlab # [ 201.339129] gitlab-workhorse[825]: time="2026-09-03T10:16:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521946gitlab # [ 201.339595] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:21 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4401947gitlab # [ 201.343506] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:21 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 7541948gitlab # [ 201.344393] nixbot[2630]: {"ts": "2026-09-03T10:16:21.510Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1949gitlab # To http://gitlab/root/test-flake.git1950gitlab # 0979521..cd5b8e6 master -> master1951gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.60 seconds)1952gitlab: must succeed: git -C /tmp/test-flake rev-parse master1953gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1954gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd5b8e63477d3fd8187e0e7539aea19139d2d15a'1955gitlab # [ 201.414236] nixbot[2630]: INFO: ::ffff:127.0.0.1:57174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd5b8e63477d3fd8187e0e7539aea19139d2d15a HTTP/1.1" 200 OK1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd5b8e63477d3fd8187e0e7539aea19139d2d15a', in 0.06 seconds)1957gitlab # [ 201.421504] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 661958gitlab # [ 201.423590] nixbot[2630]: {"ts": "2026-09-03T10:16:21.587Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1959gitlab # [ 201.489239] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:21 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 621960gitlab # [ 201.495900] nixbot[2630]: {"ts": "2026-09-03T10:16:21.661Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1961gitlab # [ 201.576660] gitaly[870]: time="2026-09-03T10:16:21.742Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9ZX2FR1A0J2ZGYB1FWN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-03T10:16:51.525" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=255 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:16:21.726" grpc.time_ms=15.629 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 201.627313] gitaly[870]: time="2026-09-03T10:16:21.792Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9ZX2FR1A0J2ZGYB1FWN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:16:51.590" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:21.791" grpc.time_ms=0.945 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1963gitlab # [ 201.667785] gitaly[870]: time="2026-09-03T10:16:21.833Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1KC9ZX2FR1A0J2ZGYB1FWN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-03T10:16:31.021" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:21.821" grpc.time_ms=11.226 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1964gitlab # [ 201.694192] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 772 "" "python-httpx/0.28.1" 1921965gitlab # [ 201.696530] nixbot[2630]: {"ts": "2026-09-03T10:16:21.861Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1966gitlab # [ 201.809596] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1081967gitlab # [ 201.810719] nixbot[2630]: {"ts": "2026-09-03T10:16:21.976Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1968gitlab # [ 201.814401] nixbot[2630]: {"ts": "2026-09-03T10:16:21.980Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1969gitlab # [ 201.997539] gitaly[870]: time="2026-09-03T10:16:22.162Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1KCA08D5TYPX15VXCQF03FW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.150" grpc.time_ms=11.933 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc1970gitlab # [ 201.998059] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1331971gitlab # [ 202.115483] gitaly[870]: time="2026-09-03T10:16:22.281Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA0DN7WJZE7PGND8J10JR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.269" pid=870 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1972gitlab # [ 202.115769] gitaly[870]: time="2026-09-03T10:16:22.281Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA0DN7WJZE7PGND8J10JR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.269" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc1973gitlab # [ 202.116853] gitaly[870]: time="2026-09-03T10:16:22.282Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA0DN7WJZE7PGND8J10JR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.269" grpc.time_ms=12.178 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc1974gitlab # [ 202.117984] gitlab-workhorse[825]: time="2026-09-03T10:16:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131975gitlab # [ 202.119422] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 851976gitlab # [ 202.312251] gitaly[870]: time="2026-09-03T10:16:22.477Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA0JHNX93EKE6NC03RW4B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.454" pid=870 remote_ip="2001:db8:1::1" request_sha=24df6ef3c3a55a4fac69373f11cd6d5014740049 response_bytes=418 span.kind=server system=grpc1977gitlab # [ 202.312526] gitaly[870]: time="2026-09-03T10:16:22.478Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA0JHNX93EKE6NC03RW4B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.454" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc1978gitlab # [ 202.313630] gitaly[870]: time="2026-09-03T10:16:22.478Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA0JHNX93EKE6NC03RW4B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.454" grpc.time_ms=23.417 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc1979gitlab # [ 202.375190] gitlab-workhorse[825]: time="2026-09-03T10:16:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4181980gitlab # [ 202.377092] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 1871981gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd5b8e63477d3fd8187e0e7539aea19139d2d15a'1982gitlab # [ 202.454173] nixbot[2630]: INFO: ::ffff:127.0.0.1:57184 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd5b8e63477d3fd8187e0e7539aea19139d2d15a HTTP/1.1" 200 OK1983gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd5b8e63477d3fd8187e0e7539aea19139d2d15a', in 0.04 seconds)1984gitlab # [ 202.495266] gitaly[870]: time="2026-09-03T10:16:22.660Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCA0STRN6Z1HF1YZ21KM3A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.649" grpc.time_ms=11.207 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc1985gitlab # [ 202.520909] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 991986gitlab # [ 202.573285] gitaly[870]: time="2026-09-03T10:16:22.738Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA0X08FXHKSWZ8VDS54WY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.726" pid=870 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1987gitlab # [ 202.573546] gitaly[870]: time="2026-09-03T10:16:22.739Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA0X08FXHKSWZ8VDS54WY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.726" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc1988gitlab # [ 202.616986] gitaly[870]: time="2026-09-03T10:16:22.782Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA0X08FXHKSWZ8VDS54WY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.726" grpc.time_ms=55.844 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc1989gitlab # [ 202.618134] gitlab-workhorse[825]: time="2026-09-03T10:16:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671990gitlab # [ 202.619328] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 941991gitlab # [ 202.715022] gitaly[870]: time="2026-09-03T10:16:22.880Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1KCA11FNEXRXYSVYB5GSR2A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.868" grpc.time_ms=11.836 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc1992gitlab # [ 202.715968] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 491993gitlab # [ 202.803650] gitaly[870]: time="2026-09-03T10:16:22.969Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA133Y1HZ6K9GXFRZ7Y5Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.948" pid=870 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1994gitlab # [ 202.804185] gitaly[870]: time="2026-09-03T10:16:22.969Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA133Y1HZ6K9GXFRZ7Y5Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.948" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc1995gitlab # [ 202.805607] gitaly[870]: time="2026-09-03T10:16:22.969Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA133Y1HZ6K9GXFRZ7Y5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:22.948" grpc.time_ms=21.075 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc1996gitlab # [ 202.807364] gitlab-workhorse[825]: time="2026-09-03T10:16:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161997gitlab # [ 202.808453] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 861998gitlab # [ 202.943956] gitaly[870]: time="2026-09-03T10:16:23.109Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA18EJS258TRMBNFA0WVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:16:53.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:23.109" grpc.time_ms=0.433 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 202.977414] gitaly[870]: time="2026-09-03T10:16:23.143Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCA18EJS258TRMBNFA0WVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-03T10:16:53.036" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:16:23.136" grpc.time_ms=6.313 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 203.010304] gitaly[870]: time="2026-09-03T10:16:23.175Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCA18EJS258TRMBNFA0WVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:16:33.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:16:23.170" grpc.time_ms=4.989 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 203.020453] gitaly[870]: time="2026-09-03T10:16:23.186Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCA18EJS258TRMBNFA0WVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:16:33.020" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:16:23.181" grpc.time_ms=4.766 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2002gitlab # [ 203.095720] gitaly[870]: time="2026-09-03T10:16:23.261Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA18EJS258TRMBNFA0WVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-03T10:16:33.100" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:23.260" grpc.time_ms=0.328 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2003gitlab # [ 203.135367] gitaly[870]: time="2026-09-03T10:16:23.301Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA18EJS258TRMBNFA0WVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-03T10:16:33.130" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:16:23.291" grpc.time_ms=9.611 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2004gitlab # [ 203.202965] gitaly[870]: time="2026-09-03T10:16:23.368Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCA18EJS258TRMBNFA0WVW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:23.367" grpc.time_ms=0.531 pid=870 span.kind=server system=grpc2005gitlab # [ 203.251935] gitaly[870]: time="2026-09-03T10:16:23.417Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCA18EJS258TRMBNFA0WVW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:16:23.415" grpc.time_ms=2.332 pid=870 span.kind=server system=grpc2006gitlab # [ 203.272330] gitaly[870]: time="2026-09-03T10:16:23.437Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA18EJS258TRMBNFA0WVW diskcache=48dc6038-68c8-483b-8150-ef6e87a77ebd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-03T10:16:33.163" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:23.323" pid=870 ref=refs/keep-around/cd5b8e63477d3fd8187e0e7539aea19139d2d15a remote_ip="2001:db8:1::1" revision=cd5b8e63477d3fd8187e0e7539aea19139d2d15a span.kind=server system=grpc username=root2007gitlab # [ 203.282749] gitaly[870]: time="2026-09-03T10:16:23.438Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=87 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5359 command.oublock=8 command.real_time_ms=106 command.spawn_token_fork_ms=2 command.system_time_ms=48 command.user_time_ms=39 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA18EJS258TRMBNFA0WVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-03T10:16:33.163" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:16:23.323" grpc.time_ms=114.755 pid=870 ref=refs/keep-around/cd5b8e63477d3fd8187e0e7539aea19139d2d15a remote_ip="2001:db8:1::1" revision=cd5b8e63477d3fd8187e0e7539aea19139d2d15a span.kind=server system=grpc username=root2008gitlab # [ 203.296143] gitaly[870]: time="2026-09-03T10:16:23.448Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA18EJS258TRMBNFA0WVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:16:53.343" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:23.443" grpc.time_ms=4.986 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2009gitlab # [ 203.426279] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd5b8e63477d3fd8187e0e7539aea19139d2d15a HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5362010gitlab # [ 203.432859] nixbot[2630]: {"ts": "2026-09-03T10:16:23.592Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd5b8e63477d3fd8187e0e7539aea19139d2d15a \"HTTP/1.1 201 Created\""}2011gitlab # [ 203.439271] nixbot[2630]: {"ts": "2026-09-03T10:16:23.602Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-cd5b8e63477d-0"}2012gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd5b8e63477d3fd8187e0e7539aea19139d2d15a'2013gitlab # [ 203.487753] nixbot[2630]: INFO: ::ffff:127.0.0.1:35518 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cd5b8e63477d3fd8187e0e7539aea19139d2d15a HTTP/1.1" 200 OK2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cd5b8e63477d3fd8187e0e7539aea19139d2d15a', in 0.03 seconds)2015(finished: subtest: push delivers the webhook, in 2.74 seconds)2016subtest: eval and build post commit statuses2017gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2018gitlab # [ 203.570053] gitaly[870]: time="2026-09-03T10:16:23.735Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA1WA3RZGNWZXRVKF2FCH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:16:53.634" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:23.734" grpc.time_ms=0.785 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2019gitlab # [ 203.588465] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 632020gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.10 seconds)2021gitlab # [ 203.610739] nixbot[2630]: {"ts": "2026-09-03T10:16:23.776Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-cd5b8e63477d-0", "argv0": "bwrap"}2022gitlab # [ 203.690828] systemd[1]: Started Nix Daemon.2023gitlab # [ 203.758587] nix-daemon[2874]: accepted connection from pid 2869, user nixbot2024gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2025gitlab # [ 204.687634] gitaly[870]: time="2026-09-03T10:16:24.852Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA2YQPKDZBP6RT615YSF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:16:54.751" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:24.851" grpc.time_ms=0.817 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026gitlab # [ 204.757324] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1302027gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.17 seconds)2028gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2029gitlab # [ 205.864759] gitaly[870]: time="2026-09-03T10:16:26.029Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA43D5PTDW90VE7AHTHDQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:16:56.027" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:26.028" grpc.time_ms=0.874 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2030gitlab # [ 205.885709] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 832031gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.13 seconds)2032gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2033gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.12 seconds)2034gitlab # [ 206.995359] gitaly[870]: time="2026-09-03T10:16:27.160Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA56TNGRFZ7D3T3Z25YK1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:16:57.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:27.159" grpc.time_ms=0.867 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab # [ 207.025732] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 872036gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2037gitlab # [ 208.136634] gitaly[870]: time="2026-09-03T10:16:28.301Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA69YTFQQVWAWJP3Z65KF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:16:58.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:28.300" grpc.time_ms=0.824 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 208.260272] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2012039gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.24 seconds)2040gitlab # [ 208.471474] nix-daemon[2874]: accepted connection from pid 2913, user nixbot2041gitlab # [ 208.481251] nix-daemon[2874]: accepted connection from pid 2869, user nixbot2042gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2043gitlab # [ 209.362110] gitaly[870]: time="2026-09-03T10:16:29.526Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA7GTXYXBTQ7YGGYXV7X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:16:59.425" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:29.525" grpc.time_ms=0.867 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2044gitlab # [ 209.393239] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 912045gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.13 seconds)2046gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2047gitlab # [ 210.489609] gitaly[870]: time="2026-09-03T10:16:30.654Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA8M6M2BJE25TGBJ8RG78 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:17:00.553" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:30.654" grpc.time_ms=0.64 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048gitlab # [ 210.523274] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 892049gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.13 seconds)2050gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2051gitlab # [ 211.624781] gitaly[870]: time="2026-09-03T10:16:31.789Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCA9QFA8Q5QK4RJMQJE3WC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:17:01.588" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:31.788" grpc.time_ms=0.925 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 211.689293] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1252053gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.17 seconds)2054gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2055gitlab # [ 212.795507] gitaly[870]: time="2026-09-03T10:16:32.960Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCAAVY1JNJHPZ0N153ZFR5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:17:02.858" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:32.959" grpc.time_ms=0.826 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2056gitlab # [ 212.826636] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 932057gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.14 seconds)2058gitlab # [ 213.254403] nix-daemon[2874]: accepted connection from pid 2869, user nixbot2059gitlab # [ 213.349284] nix-daemon[2874]: accepted connection from pid 2955, user nixbot2060gitlab # [ 213.454672] gitaly[870]: time="2026-09-03T10:16:33.620Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCABEV55R3FBCWA44NWW6A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:17:03.518" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:33.619" grpc.time_ms=0.957 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 213.510252] gitaly[870]: time="2026-09-03T10:16:33.674Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1KCABEV55R3FBCWA44NWW6A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:16:43.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:16:33.666" grpc.time_ms=8.576 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062gitlab # [ 213.577536] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd5b8e63477d3fd8187e0e7539aea19139d2d15a HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2432063gitlab # [ 213.580325] nixbot[2630]: {"ts": "2026-09-03T10:16:33.745Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd5b8e63477d3fd8187e0e7539aea19139d2d15a \"HTTP/1.1 201 Created\""}2064gitlab # [ 213.646531] gitaly[870]: time="2026-09-03T10:16:33.812Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCABPP9NQ7KDRV9FGCNY6G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:17:03.710" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:33.811" grpc.time_ms=0.795 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 213.698804] gitaly[870]: time="2026-09-03T10:16:33.864Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCABPP9NQ7KDRV9FGCNY6G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:16:43.194" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:16:33.855" grpc.time_ms=9.143 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 213.758592] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd5b8e63477d3fd8187e0e7539aea19139d2d15a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1732067gitlab # [ 213.764500] nixbot[2630]: {"ts": "2026-09-03T10:16:33.925Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd5b8e63477d3fd8187e0e7539aea19139d2d15a \"HTTP/1.1 201 Created\""}2068gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2069gitlab # [ 213.930074] gitaly[870]: time="2026-09-03T10:16:34.095Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCABZJYK9ZPDZEWWKTG6PP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:17:04.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:34.094" grpc.time_ms=0.833 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2070gitlab # [ 213.961736] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 1313 "" "curl/8.21.0" 922071gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.13 seconds)2072gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2073gitlab # [ 215.069371] gitaly[870]: time="2026-09-03T10:16:35.233Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCAD30M2TN64WCZZ927MHM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:17:05.131" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:35.232" grpc.time_ms=1.123 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab # [ 215.096601] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 1313 "" "curl/8.21.0" 922075gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.14 seconds)2076gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2077gitlab # [ 216.198532] gitaly[870]: time="2026-09-03T10:16:36.363Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCAE6GJT3G1TGCD6SSPN9H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:17:06.161" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:36.362" grpc.time_ms=0.875 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab # [ 216.266236] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 1313 "" "curl/8.21.0" 1262079gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.17 seconds)2080gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2081gitlab # [ 217.371654] gitaly[870]: time="2026-09-03T10:16:37.536Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCAFB2Q6KYYQGKM143YBRJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:17:07.334" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:37.535" grpc.time_ms=0.944 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 217.422558] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 1313 "" "curl/8.21.0" 1132083gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.15 seconds)2084gitlab # [ 218.027789] nix-daemon[2874]: accepted connection from pid 3005, user nixbot2085gitlab # [ 218.129434] gitaly[870]: time="2026-09-03T10:16:38.294Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCAG2G37Y7HEARQ87ZNP31 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:17:08.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:38.293" grpc.time_ms=0.798 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 218.196345] gitaly[870]: time="2026-09-03T10:16:38.361Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCAG2G37Y7HEARQ87ZNP31 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:16:48.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:16:38.352" grpc.time_ms=9.224 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 218.239968] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd5b8e63477d3fd8187e0e7539aea19139d2d15a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1802088gitlab # [ 218.247398] nixbot[2630]: {"ts": "2026-09-03T10:16:38.412Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd5b8e63477d3fd8187e0e7539aea19139d2d15a \"HTTP/1.1 201 Created\""}2089gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses2090gitlab # [ 218.429270] gitaly[870]: time="2026-09-03T10:16:38.594Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1KCAGCAAW2Q9RK1PVK6PY5C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:38.586" grpc.time_ms=7.037 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc2091gitlab # [ 218.458399] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 552092gitlab # [ 218.512054] gitaly[870]: time="2026-09-03T10:16:38.677Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCAGFJSDADD762YMXTH09D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:17:08.476" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:16:38.676" grpc.time_ms=0.876 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 218.539611] gitaly[870]: time="2026-09-03T10:16:38.683Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCAGF38DPXPQDM2GRG9A9C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:38.675" pid=870 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2094gitlab # [ 218.558077] gitlab-workhorse[825]: time="2026-09-03T10:16:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672095gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses, in 0.13 seconds)2096(finished: subtest: eval and build post commit statuses, in 15.07 seconds)2097gitlab # [ 218.561166] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 562098(finished: run the VM test script, in 287.24 seconds)2099gitlab # [ 218.563064] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/03:10:16:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cd5b8e63477d3fd8187e0e7539aea19139d2d15a/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 582100gitlab # [ 218.565646] gitaly[870]: time="2026-09-03T10:16:38.683Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCAGF38DPXPQDM2GRG9A9C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:38.675" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc2101gitlab # [ 218.577795] gitaly[870]: time="2026-09-03T10:16:38.684Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCAGF38DPXPQDM2GRG9A9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:16:38.675" grpc.time_ms=8.295 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=870 remote_ip="2001:db8:1::1" span.kind=server system=grpc2102test script finished in 287.29s2103cleanup2104kill QemuMachine (pid 46)2105gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2106(finished: cleanup, in 1.36 seconds)2107additionally exposed symbols:2108 gitlab,2109 vlan1,2110 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2111[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-03T10:16:20.718Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2112[]2113[]2114[{'id': 1, 'project_id': 1, 'number': 1, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-03T10:16:23.047471Z', 'started_at': '2026-09-03T10:16:23.598216Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2115[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2116[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2117[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2118[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2119[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2120[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2121[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2122[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2123[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2124[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': '2026-09-03T10:16:33.710Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-09-03T10:16:33.897Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2125[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': '2026-09-03T10:16:33.710Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-09-03T10:16:33.897Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2126[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': '2026-09-03T10:16:33.710Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-09-03T10:16:33.897Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2127[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': '2026-09-03T10:16:33.710Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-09-03T10:16:33.897Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2128[{'id': 1, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-03T10:16:23.565Z', 'started_at': None, 'finished_at': '2026-09-03T10:16:33.710Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'cd5b8e63477d3fd8187e0e7539aea19139d2d15a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': '1 attributes built', 'created_at': '2026-09-03T10:16:33.897Z', 'started_at': None, 'finished_at': '2026-09-03T10:16:38.383Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]