vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #307
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.2Ok98gUaDM', fmt=raw size=107374182412(finished: start all VMs, in 71.25 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: ffeb81d7-49e8-46d7-b75c-d9a9a3d8cdbc19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4ncnzkakhxyx17g0sfxnjificklahba8-nixos-system-gitlab-test/init regInfo=/nix/store/8y74a8w8q3qsm6c8fr0d9d0vf6vdyifj-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/8y74a8w8q3qsm6c8fr0d9d0vf6vdyifj-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000028] arm-pv: using stolen time PV108gitlab # [ 0.000415] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000606] Console: colour dummy device 80x25110gitlab # [ 0.000614] printk: legacy console [tty0] enabled111gitlab # [ 0.000795] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000802] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000878] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001013] landlock: Up and running.115gitlab # [ 0.001016] Yama: becoming mindful.116gitlab # [ 0.001467] LSM support for eBPF active117gitlab # [ 0.001671] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001780] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002920] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003616] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003620] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003777] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004818] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004911] EFI services will not be available.125gitlab # [ 0.005097] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005729] Detected PIPT I-cache on CPU1127gitlab # [ 0.005830] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005961] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006090] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007218] Detected PIPT I-cache on CPU2131gitlab # [ 0.007325] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007456] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007585] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008645] Detected PIPT I-cache on CPU3135gitlab # [ 0.008761] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008892] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.009022] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009522] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009550] SMP: Total of 4 processors activated.140gitlab # [ 0.009552] CPU: All CPU(s) started at EL1141gitlab # [ 0.009561] CPU features: detected: Branch Target Identification142gitlab # [ 0.009565] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009568] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009571] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009575] CPU features: detected: Common not Private translations146gitlab # [ 0.009577] CPU features: detected: CRC32 instructions147gitlab # [ 0.009580] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009583] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009586] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009589] CPU features: detected: E0PD151gitlab # [ 0.009591] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009594] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009597] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009600] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009603] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009607] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009609] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009612] CPU features: detected: Privileged Access Never159gitlab # [ 0.009614] CPU features: detected: PMUv3160gitlab # [ 0.009616] CPU features: detected: RAS Extension Support161gitlab # [ 0.009618] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009621] CPU features: detected: Random Number Generator163gitlab # [ 0.009624] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009626] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009629] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009632] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009760] alternatives: applying system-wide alternatives168gitlab # [ 0.012666] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012829] Memory: 5963756K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014298] devtmpfs: initialized171gitlab # [ 0.018274] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018341] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018552] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018556] 0 pages in range for non-PLT usage175gitlab # [ 0.018558] 508288 pages in range for PLT usage176gitlab # [ 0.018676] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019539] DMI not present or invalid.178gitlab # [ 0.022781] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.025618] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025915] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.027797] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.027821] audit: initializing netlink subsys (disabled)183gitlab # [ 0.028147] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.028553] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.028555] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.028560] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.028562] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.028565] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.028650] cpuidle: using governor ladder190gitlab # [ 0.028714] cpuidle: using governor menu191gitlab # [ 0.028913] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.029122] ASID allocator initialised with 65536 entries193gitlab # [ 0.030191] Serial: AMBA PL011 UART driver194gitlab # [ 0.035358] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.035650] printk: console [ttyAMA0] enabled196gitlab # [ 0.047207] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.047228] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.047238] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.047246] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.047254] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.047262] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.047270] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.047278] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.059388] fbcon: Taking over console205gitlab # [ 0.059400] ACPI: Interpreter disabled.206gitlab # [ 0.060412] iommu: Default domain type: Translated207gitlab # [ 0.060416] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.069242] SCSI subsystem initialized209gitlab # [ 0.070448] usbcore: registered new interface driver usbfs210gitlab # [ 0.070579] usbcore: registered new interface driver hub211gitlab # [ 0.070655] usbcore: registered new device driver usb212gitlab # [ 0.071515] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.071527] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.071580] PTP clock support registered215gitlab # [ 0.071721] EDAC MC: Ver: 3.0.0216gitlab # [ 0.072292] scmi_core: SCMI protocol bus registered217gitlab # [ 0.073139] FPGA manager framework218gitlab # [ 0.075505] vgaarb: loaded219gitlab # [ 0.077050] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.077504] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.077527] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.081727] netfs: FS-Cache loaded223gitlab # [ 0.082076] pnp: PnP ACPI: disabled224gitlab # [ 0.091093] NET: Registered PF_INET protocol family225gitlab # [ 0.092228] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.123552] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.123602] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.123647] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.123912] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.124481] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.124572] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.124627] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.124739] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.124966] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.124984] NET: Registered PF_XDP protocol family236gitlab # [ 0.124998] PCI: CLS 0 bytes, default 64237gitlab # [ 0.125456] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.137368] kvm [1]: HYP mode not available239gitlab # [ 0.185114] Initialise system trusted keyrings240gitlab # [ 0.185292] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.185785] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.185905] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.197875] Key type asymmetric registered244gitlab # [ 0.197881] Asymmetric key parser 'x509' registered245gitlab # [ 0.197939] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.198351] io scheduler mq-deadline registered247gitlab # [ 0.198374] io scheduler kyber registered248gitlab # [ 0.213510] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.217424] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.217833] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.217849] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.217860] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.217867] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.217890] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.217912] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.218045] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.218053] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.218058] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.218062] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.218066] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.218190] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.218841] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.219147] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.219169] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.219203] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.219219] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.219949] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.220272] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.220291] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.220326] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.221035] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.221321] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.221336] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.221370] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.222062] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.222375] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.222391] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.222425] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.223092] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.223391] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.223406] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.223454] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.224148] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.224492] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.224507] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.224542] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.225265] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.225560] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.225575] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.225614] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.225629] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.226476] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.226846] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.226900] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.227731] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.228143] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.228178] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.228824] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.229142] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.229522] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.229961] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.229976] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.230015] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.230808] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.231125] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.231140] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.231191] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.232139] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.232147] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.232152] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.232228] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.232300] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.232364] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.232441] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.232502] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.232563] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.232623] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.232702] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.232773] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.232887] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.232964] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.232986] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.233008] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.233030] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.233071] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.233095] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.233117] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.233140] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.233168] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.233190] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.233212] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.233235] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.233256] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.233277] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.233310] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.233332] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.233353] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.233380] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.233401] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.233423] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.233450] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.233477] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.233484] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.233488] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.235436] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.268262] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.274141] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.280185] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.286771] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.292819] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.299356] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.305706] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.312399] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.317645] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.322967] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.328538] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.343612] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.347806] msm_serial: driver initialized359gitlab # [ 0.348187] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.348309] STM32 USART driver initialized361gitlab # [ 0.388905] loop: module loaded362gitlab # [ 0.389266] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.392826] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.396148] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.399656] virtio_blk virtio5: [vdb] 12284600 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.403251] megasas: 07.734.00.00-rc1367gitlab # [ 0.404529] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.410617] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.410714] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.413695] Using buffer write method371gitlab # [ 0.413739] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.417662] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.417688] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.420252] Using buffer write method375gitlab # [ 0.420274] Concatenating MTD devices:376gitlab # [ 0.420278] (0): "0.flash"377gitlab # [ 0.420282] (1): "0.flash"378gitlab # [ 0.420286] into device "0.flash"379gitlab # [ 0.641463] Freeing initrd memory: 27184K380gitlab # [ 0.653204] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.657269] thunder_xcv, ver 1.0382gitlab # [ 0.657315] thunder_bgx, ver 1.0383gitlab # [ 0.657347] nicpf, ver 1.0384gitlab # [ 0.657983] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.657988] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.658014] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.658021] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.658048] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.658052] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.658079] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.658084] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.658258] sky2: driver version 1.30393gitlab # [ 0.660130] usbcore: registered new interface driver usb-storage394gitlab # [ 0.660232] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.660249] usbserial: USB Serial support registered for generic396gitlab # [ 0.660938] hv_vmbus: registering driver hyperv_keyboard397gitlab # [ 0.661231] ehci-pci 0000:00:0a.0: EHCI Host Controller398gitlab # [ 0.661278] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1399gitlab # [ 0.661951] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000400gitlab # [ 0.662154] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.662183] rtc-pl031 9010000.pl031: setting system clock to 2026-09-04T06:40:44 UTC (1788504044)402gitlab # [ 0.662536] i2c_dev: i2c /dev entries driver403gitlab # [ 0.665754] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 0.665760] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 0.666069] Synopsys Designware Multimedia Card Interface Driver406gitlab # [ 0.666499] sdhci-pltfm: SDHCI platform and OF driver helper407gitlab # [ 0.668472] hid: raw HID events driver (C) Jiri Kosina408gitlab # [ 0.668806] usbcore: registered new interface driver usbhid409gitlab # [ 0.668811] usbhid: USB HID core driver410gitlab # [ 0.673164] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00411gitlab # [ 0.674258] hub 1-0:1.0: USB hub found412gitlab # [ 0.674324] hub 1-0:1.0: 6 ports detected413gitlab # [ 0.678865] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.681440] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.681657] NET: Registered PF_INET6 protocol family416gitlab # [ 0.682973] Segment Routing with IPv6417gitlab # [ 0.682994] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.683035] NET: Registered PF_PACKET protocol family419gitlab # [ 0.683249] 9pnet: Installing 9P2000 support420gitlab # [ 0.685735] Key type dns_resolver registered421gitlab # [ 0.695251] registered taskstats version 1422gitlab # [ 0.695524] Loading compiled-in X.509 certificates423gitlab # [ 0.707032] Demotion targets for Node 0: null424gitlab # [ 0.707165] Key type .fscrypt registered425gitlab # [ 0.707169] Key type fscrypt-provisioning registered426gitlab # [ 0.707323] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.707343] ima: Allocated hash algorithm: sha1428gitlab # [ 0.707365] ima: No architecture policies found429gitlab # [ 0.708195] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.730621] clk: Disabling unused clocks431gitlab # [ 0.730636] PM: genpd: Disabling unused power domains432gitlab # [ 0.735346] Freeing unused kernel memory: 4736K433gitlab # [ 0.735540] Run /init as init process434gitlab # [ 0.762505] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.921127] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.075714] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.096778] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.096847] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.096919] systemd[1]: Detected architecture arm64.440gitlab # [ 1.096935] systemd[1]: Running in initrd.441gitlab # [ 1.097819] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.098064] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.189700] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.309142] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.345289] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.443320] systemd[1]: Queued start job for default target Initrd Default Target.447gitlab # [ 1.471109] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2448gitlab # [ 1.471465] systemd[1]: Created slice Slice /system/modprobe.449gitlab # [ 1.471909] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.450gitlab # [ 1.471973] systemd[1]: Expecting device /dev/disk/by-label/nix-store...451gitlab # [ 1.472002] systemd[1]: Expecting device /dev/disk/by-label/nixos...452gitlab # [ 1.472046] systemd[1]: Reached target Path Units.453gitlab # [ 1.472101] systemd[1]: Reached target Slice Units.454gitlab # [ 1.472139] systemd[1]: Reached target Swaps.455gitlab # [ 1.472177] systemd[1]: Reached target Timer Units.456gitlab # [ 1.472495] systemd[1]: Listening on D-Bus System Message Bus Socket.457gitlab # [ 1.472834] systemd[1]: Listening on Journal Socket (/dev/log).458gitlab # [ 1.473377] systemd[1]: Listening on Journal Sockets.459gitlab # [ 1.473437] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0460gitlab # [ 1.474018] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.474190] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.474231] systemd[1]: Reached target Socket Units.463gitlab # [ 1.477413] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.480524] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.480656] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.484233] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.509014] systemd[1]: Starting Journal Service...468gitlab # [ 1.517276] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.517441] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.521677] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.523909] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.529258] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.529810] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.530577] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.533556] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.557562] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0477gitlab # [ 1.557882] [drm] features: -virgl +edid -resource_blob -host_visible478gitlab # [ 1.557889] [drm] features: -context_init479gitlab # [ 1.559453] [drm] number of scanouts: 1480gitlab # [ 1.559476] [drm] number of cap sets: 0481gitlab # [ 1.562346] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.482gitlab # [ 1.566258] systemd-journald[94]: Collecting audit messages is disabled.483gitlab # [ 1.573209] systemd[1]: Starting Create Static Device Nodes in /dev...484gitlab # [ 1.574605] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.485gitlab # [ 1.575461] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev486gitlab # [ 1.576119] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic487gitlab # [ 1.576133] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0488gitlab # [ 1.598643] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.599731] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.611213] systemd[1]: Finished Load Kernel Modules.491gitlab # [ 1.613542] systemd[1]: Starting Apply Kernel Variables...492gitlab # [ 1.622212] systemd[1]: Started Journal Service.493gitlab # [ 1.617689] systemd-modules-load[95]: Using 4 probe threads494gitlab # [ 1.621534] systemd-modules-load[95]: Module 'virtio_balloon' is built in495gitlab # [ 1.622676] systemd-modules-load[95]: Module 'virtio_console' is built in496gitlab # [ 1.623810] systemd-modules-load[95]: Module 'virtio_rng' is built in497gitlab # [ 1.625030] systemd-modules-load[95]: Inserted module 'dm_mod'498gitlab # [ 1.625955] systemd-modules-load[95]: Inserted module 'virtio_gpu'499gitlab # [ 1.631809] systemd[1]: Finished Create Static Device Nodes in /dev.500gitlab # [ 1.632941] systemd[1]: Reached target Preparation for Local File Systems.501gitlab # [ 1.633877] systemd[1]: Reached target Local File Systems.502gitlab # [ 1.635898] systemd[1]: Starting Create System Files and Directories...503gitlab # [ 1.636940] systemd[1]: Starting Rule-based Manager for Device Events and Files...504gitlab # [ 1.648152] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.668217] systemd-udevd[115]: Using default interface naming scheme 'v261'.506gitlab # [ 1.671279] systemd[1]: Finished Create System Files and Directories.507gitlab # [ 1.682383] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.707656] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.758417] systemd-vconsole-setup[131]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.763507] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.166015] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.168548] systemd[1]: Reached target System Initialization.513gitlab # [ 2.170955] systemd[1]: Reached target Basic System.514gitlab # [ 2.400985] (udev-worker)[141]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.405862] (udev-worker)[141]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.408143] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.415540] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.420839] systemd[1]: Found device /dev/disk/by-label/nix-store.519gitlab # [ 2.423649] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.426448] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.469576] systemd-fsck[153]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.476056] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.519810] systemd[1]: Mounting /sysroot...524gitlab # [ 2.592065] EXT4-fs (vda): mounted filesystem ffeb81d7-49e8-46d7-b75c-d9a9a3d8cdbc r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.593241] systemd[1]: Mounted /sysroot.526gitlab # [ 2.596744] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.600718] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.604772] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.620687] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.624486] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.629441] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.634721] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.650664] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.654123] systemd[1]: Mounted /sysroot/run.535gitlab # [ 2.661669] systemd-sysroot-fstab-check[168]: /sysroot should be mounted in the initrd, will request daemon-reload.536gitlab # [ 2.677040] systemd[1]: Starting rw-sysroot-nix-store.service...537gitlab # [ 2.686812] systemd[1]: Reload requested from client PID 168 ('systemd-sysroot') (unit initrd-parse-etc.service)...538gitlab # [ 2.688671] systemd[1]: Reloading...539gitlab # [ 2.708247] erofs (device vdb): mounted with root inode @ nid 128.540gitlab # [ 2.813679] systemd[1]: Reloading finished in 124 ms.541gitlab # [ 2.877675] systemd-sysroot-fstab-check[168]: Requesting initrd-fs.target/start/replace...542gitlab # [ 2.881082] systemd[1]: Mounted /sysroot/nix/.ro-store.543gitlab # [ 2.882719] systemd[1]: Mounted /sysroot/tmp/shared.544gitlab # [ 2.883747] systemd[1]: Mounted /sysroot/tmp/xchg.545gitlab # [ 2.884874] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 2.886186] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 2.887694] systemd-sysroot-fstab-check[168]: Requesting swap.target/start/replace...548gitlab # [ 2.893840] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 2.894874] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 2.895868] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 2.896917] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 2.907719] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 2.911533] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 2.912453] systemd[1]: Mounting /sysroot/nix/store...555gitlab # [ 2.938980] systemd[1]: Mounted /sysroot/nix/store.556gitlab # [ 2.940822] systemd[1]: Reached target Initrd File Systems.557gitlab # [ 2.945183] systemd[1]: Starting Find NixOS closure...558gitlab # [ 2.947535] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...559gitlab # [ 2.964242] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.560gitlab # [ 2.971002] systemd[1]: Finished Find NixOS closure.561gitlab # [ 2.971900] systemd[1]: Reached target Initrd Default Target.562gitlab # [ 2.976300] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...563gitlab # [ 2.992528] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.564gitlab # [ 2.994368] (udev-worker)[123]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory565gitlab # [ 3.000315] (udev-worker)[123]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory566gitlab # [ 3.003454] systemd[1]: Stopped Virtual Console Setup.567gitlab # [ 3.005109] systemd[1]: Stopping Virtual Console Setup...568gitlab # [ 3.006032] systemd[1]: Starting Virtual Console Setup...569gitlab # [ 3.012435] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.570gitlab # [ 3.014177] systemd[1]: Stopped Virtual Console Setup.571gitlab # [ 3.017096] systemd[1]: Stopped target Initrd Default Target.572gitlab # [ 3.017903] systemd[1]: Stopped target Basic System.573gitlab # [ 3.018600] systemd[1]: Stopped target Initrd Root Device.574gitlab # [ 3.019363] systemd[1]: Stopped target Path Units.575gitlab # [ 3.020067] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.576gitlab # [ 3.021102] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.577gitlab # [ 3.022164] systemd[1]: Stopped target Slice Units.578gitlab # [ 3.022862] systemd[1]: Stopped target Socket Units.579gitlab # [ 3.023578] systemd[1]: Stopped target System Initialization.580gitlab # [ 3.024448] systemd[1]: Stopped target Swaps.581gitlab # [ 3.025127] systemd[1]: Stopped target Timer Units.582gitlab # [ 3.025954] systemd[1]: dbus.socket: Deactivated successfully.583gitlab # [ 3.026876] systemd[1]: Closed D-Bus System Message Bus Socket.584gitlab # [ 3.027723] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.585gitlab # [ 3.028843] systemd[1]: Stopped Find NixOS closure.586gitlab # [ 3.029546] systemd[1]: Starting Load Kernel Module 9pnet_virtio...587gitlab # [ 3.031348] systemd[1]: Starting rw-sysroot-nix-store.service...588gitlab # [ 3.032256] systemd[1]: systemd-sysctl.service: Deactivated successfully.589gitlab # [ 3.033177] systemd[1]: Stopped Apply Kernel Variables.590gitlab # [ 3.034819] systemd[1]: systemd-modules-load.service: Deactivated successfully.591gitlab # [ 3.035890] systemd[1]: Stopped Load Kernel Modules.592gitlab # [ 3.036665] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.593gitlab # [ 3.037777] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.594gitlab # [ 3.039004] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.595gitlab # [ 3.040007] systemd[1]: Stopped Create System Files and Directories.596gitlab # [ 3.040932] systemd[1]: Stopped target Local File Systems.597gitlab # [ 3.041707] systemd[1]: Stopped target Preparation for Local File Systems.598gitlab # [ 3.042646] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.599gitlab # [ 3.043643] systemd[1]: Stopped Coldplug All udev Devices.600gitlab # [ 3.044459] systemd[1]: Stopping Rule-based Manager for Device Events and Files...601gitlab # [ 3.045490] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.602gitlab # [ 3.046494] systemd[1]: Finished Load Kernel Module 9pnet_virtio.603gitlab # [ 3.047353] systemd[1]: initrd-cleanup.service: Deactivated successfully.604gitlab # [ 3.048356] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.605gitlab # [ 3.049272] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.606gitlab # [ 3.050265] systemd[1]: Finished rw-sysroot-nix-store.service.607gitlab # [ 3.054693] systemd[1]: systemd-udevd.service: Deactivated successfully.608gitlab # [ 3.055640] systemd[1]: Stopped Rule-based Manager for Device Events and Files.609gitlab # [ 3.056709] systemd[1]: systemd-udevd.service: Consumed 2.189s CPU time over 1.417s wall clock time, 31.8M memory peak.610gitlab # [ 3.058135] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.611gitlab # [ 3.059147] systemd[1]: Closed udev Control Socket.612gitlab # [ 3.059865] systemd[1]: Starting Cleanup udev Database...613gitlab # [ 3.060697] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.614gitlab # [ 3.061767] systemd[1]: Stopped Create Static Device Nodes in /dev.615gitlab # [ 3.062641] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.616gitlab # [ 3.063762] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.617gitlab # [ 3.064811] systemd[1]: kmod-static-nodes.service: Deactivated successfully.618gitlab # [ 3.065769] systemd[1]: Stopped Create List of Static Device Nodes.619gitlab # [ 3.133550] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.620gitlab # [ 3.136926] systemd[1]: Finished Cleanup udev Database.621gitlab # [ 3.139195] systemd[1]: Reached target Switch Root.622gitlab # [ 3.141517] systemd[1]: Starting NixOS Activation...623gitlab # [ 3.323419] initrd-nixos-activation-start[226]: booting system configuration /nix/store/4ncnzkakhxyx17g0sfxnjificklahba8-nixos-system-gitlab-test624gitlab # [ 3.384707] initrd-nixos-activation-start[226]: running activation script...625gitlab # [ 3.691713] initrd-nixos-activation-start[249]: setting up /etc...626gitlab # [ 3.832236] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.627gitlab # [ 3.836324] systemd[1]: Finished NixOS Activation.628gitlab # [ 3.838447] systemd[1]: Starting Switch Root...629gitlab # [ 3.879465] systemd[1]: Switching root.630gitlab # [ 4.041085] systemd-journald[94]: Received SIGTERM from PID 1 (systemd).631gitlab # [ 4.658817] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)632gitlab # [ 4.658955] systemd[1]: Detected virtualization qemu.633gitlab # [ 4.659042] systemd[1]: Detected architecture arm64.634gitlab # [ 4.659209] systemd[1]: Detected first boot.635gitlab # [ 4.660557] systemd[1]: Initializing machine ID from random generator.636gitlab # [ 4.905259] systemd[1]: bpf-restrict-fs: LSM BPF program attached637gitlab # [ 5.024467] systemd[1]: Applying preset policy.638gitlab # [ 5.228775] systemd[1]: Populated /etc with preset unit settings.639gitlab # [ 5.383955] systemd[1]: initrd-switch-root.service: Deactivated successfully.640gitlab # [ 5.384223] systemd[1]: Stopped initrd-switch-root.service.641gitlab # [ 5.385809] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.642gitlab # [ 5.393748] systemd[1]: Created slice Slice /system/getty.643gitlab # [ 5.396659] systemd[1]: Created slice GitLab DevOps Platform Slice.644gitlab # [ 5.400773] systemd[1]: Created slice User and Session Slice.645gitlab # [ 5.401405] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.646gitlab # [ 5.402032] systemd[1]: Started Forward Password Requests to Wall Directory Watch.647gitlab # [ 5.403172] systemd[1]: Expecting device /dev/hvc0...648gitlab # [ 5.404267] systemd[1]: Expecting device /dev/ttyAMA0...649gitlab # [ 5.405343] systemd[1]: Reached target Local Encrypted Volumes.650gitlab # [ 5.406382] systemd[1]: Stopped target initrd-fs.target.651gitlab # [ 5.407368] systemd[1]: Stopped target initrd-root-fs.target.652gitlab # [ 5.408368] systemd[1]: Stopped target initrd-switch-root.target.653gitlab # [ 5.409461] systemd[1]: Reached target Virtual Machines and Containers.654gitlab # [ 5.410546] systemd[1]: Reached target Path Units.655gitlab # [ 5.411575] systemd[1]: Reached target Remote File Systems.656gitlab # [ 5.412590] systemd[1]: Reached target Slice Units.657gitlab # [ 5.413631] systemd[1]: Reached target Swaps.658gitlab # [ 5.417547] systemd[1]: Listening on Query the User Interactively for a Password.659gitlab # [ 5.421575] systemd[1]: Listening on Process Core Dump Socket.660gitlab # [ 5.424530] systemd[1]: Listening on Credential Encryption/Decryption.661gitlab # [ 5.428167] systemd[1]: Listening on Factory Reset Management.662gitlab # [ 5.429541] systemd[1]: Listening on Hostname Service Socket.663gitlab # [ 5.438958] systemd[1]: Starting Journal Log Access Socket...664gitlab # [ 5.441365] systemd[1]: Listening on Journal Audit Socket.665gitlab # [ 5.445453] systemd[1]: Listening on Console Output Muting Service Socket.666gitlab # [ 5.447143] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.667gitlab # [ 5.448300] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os668gitlab # [ 5.449400] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki669gitlab # [ 5.455918] systemd[1]: Listening on Disk Repartitioning Service Socket.670gitlab # [ 5.457420] systemd[1]: Listening on udev Control Socket.671gitlab # [ 5.458856] systemd[1]: Listening on udev Varlink Socket.672gitlab # [ 5.501607] systemd[1]: Mounting Huge Pages File System...673gitlab # [ 5.507065] systemd[1]: Mounting POSIX Message Queue File System...674gitlab # [ 5.513032] systemd[1]: Mounting Kernel Debug File System...675gitlab # [ 5.534275] systemd[1]: Mounting Kernel Trace File System...676gitlab # [ 5.540964] systemd[1]: Starting Create List of Static Device Nodes...677gitlab # [ 5.547105] systemd[1]: Starting Load Kernel Module 9pnet_virtio...678gitlab # [ 5.548286] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs679gitlab # [ 5.558378] systemd[1]: Mounting Kernel Configuration File System...680gitlab # [ 5.559710] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm681gitlab # [ 5.561249] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore682gitlab # [ 5.582268] systemd[1]: Starting Load Kernel Module fuse...683gitlab # [ 5.583527] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67684gitlab # [ 5.598540] systemd[1]: Starting Journal Service...685gitlab # [ 5.610454] systemd[1]: Starting Load Kernel Modules...686gitlab # [ 5.621327] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...687gitlab # [ 5.629265] systemd[1]: Starting Remount Root and Kernel File Systems...688gitlab # [ 5.632566] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os689gitlab # [ 5.639736] systemd-journald[321]: Collecting audit messages is enabled.690gitlab # [ 5.642224] fuse: init (API version 7.45)691gitlab # [ 5.645314] systemd[1]: Starting Coldplug All udev Devices...692gitlab # [ 5.652613] systemd[1]: Listening on Journal Log Access Socket.693gitlab # [ 5.653754] systemd[1]: Mounted Huge Pages File System.694gitlab # [ 5.654706] systemd[1]: Mounted POSIX Message Queue File System.695gitlab # [ 5.655594] systemd[1]: Mounted Kernel Debug File System.696gitlab # [ 5.656469] systemd[1]: Mounted Kernel Trace File System.697gitlab # [ 5.658103] systemd[1]: Queued start job for default target Multi-User System.[ 5.657876] systemd[1]: Finished Create List of Static Device Nodes.698gitlab # 699gitlab # [ 5.659359] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.700gitlab # [ 5.660407] systemd[1]: Finished Load Kernel Module 9pnet_virtio.701gitlab # [ 5.661478] systemd[1]: Mounted Kernel Configuration File System.702gitlab # [ 5.662595] systemd[1]: modprobe@fuse.service: Deactivated successfully.703gitlab # [ 5.672372] systemd[1]: Unnecessary job was removed for /dev/vdb.[ 5.663802] systemd[1]: Finished Load Kernel Module fuse.704gitlab # 705gitlab # [ 5.664648] systemd[1]: Started Journal Service.706gitlab # [ 5.679472] systemd[1]: systemd-journald.service: Deactivated successfully.[ 5.685305] EXT4-fs (vda): re-mounted ffeb81d7-49e8-46d7-b75c-d9a9a3d8cdbc.707gitlab # 708gitlab # [ 5.684246] systemd-modules-load[323]: Using 3 probe threads709gitlab # [ 5.685263] systemd-modules-load[323]: Module 'atkbd' is built in710gitlab # [ 5.686325] systemd-modules-load[323]: Module 'loop' is built in711gitlab # [ 5.687387] systemd-modules-load[323]: Inserted module 'tls'712gitlab # [ 5.688420] systemd[1]: Mounting FUSE Control File System...713gitlab # [ 5.689403] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...714gitlab # [ 5.691110] systemd[1]: Finished Load Kernel Modules.715gitlab # [ 5.692057] systemd[1]: Finished Remount Root and Kernel File Systems.716gitlab # [ 5.699104] systemd[1]: Mounted FUSE Control File System.717gitlab # [ 5.703549] systemd[1]: Listening on Disk Image Download Service Socket.718gitlab # [ 5.708278] systemd[1]: Starting Firewall...719gitlab # [ 5.712442] systemd[1]: Starting Flush Journal to Persistent Storage...720gitlab # [ 5.713843] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore721gitlab # [ 5.719384] systemd[1]: Starting Load/Save OS Random Seed...722gitlab # [ 5.720753] systemd[1]: Starting Apply Kernel Variables...723gitlab # [ 5.723086] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.730055] systemd-oomd[324]: No swap; memory pressure usage will be degraded725gitlab # [ 5.731637] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.726gitlab # [ 5.736352] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.727gitlab # [ 5.740817] systemd[1]: Starting Create Static Device Nodes in /dev...728gitlab # [ 5.755562] systemd-journald[321]: Received client request to flush runtime journal.729gitlab # [ 5.771190] systemd[1]: Finished Load/Save OS Random Seed.730gitlab # [ 5.772900] systemd[1]: Reached target First Boot Complete.731gitlab # [ 5.773872] systemd[1]: Finished Apply Kernel Variables.732gitlab # [ 5.775081] systemd[1]: Finished Create Static Device Nodes in /dev.733gitlab # [ 5.776257] systemd[1]: Reached target Preparation for Local File Systems.734gitlab # [ 5.777269] systemd[1]: Starting Rule-based Manager for Device Events and Files...735gitlab # [ 5.778286] systemd[1]: Finished Flush Journal to Persistent Storage.736gitlab # [ 5.842128] systemd-udevd[356]: Using default interface naming scheme 'v261'.737gitlab # [ 5.871878] systemd[1]: Started Rule-based Manager for Device Events and Files.738gitlab # [ 6.218094] systemd[1]: Finished Firewall.739gitlab # [ 6.292610] systemd[1]: Finished Coldplug All udev Devices.740gitlab # [ 6.363425] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs741gitlab # [ 6.403669] systemd[1]: Mounting /run/wrappers...742gitlab # [ 6.421642] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.743gitlab # [ 6.460705] systemd[1]: Mounted /run/wrappers.744gitlab # [ 6.476375] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.745gitlab # [ 6.478372] systemd[1]: Reached target Local File Systems.746gitlab # [ 6.484331] systemd[1]: Listening on Boot Loader Control Service Socket.747gitlab # [ 6.486511] (udev-worker)[396]: Network interface NamePolicy= disabled on kernel command line.748gitlab # [ 6.489042] (udev-worker)[474]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.749gitlab # [ 6.492413] (udev-worker)[474]: Network interface NamePolicy= disabled on kernel command line.750gitlab # [ 6.494141] systemd[1]: Starting register-nix-paths.service...751gitlab # [ 6.511701] systemd[1]: Starting Create SUID/SGID Wrappers...752gitlab # [ 6.516287] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.753gitlab # [ 6.518302] systemd[1]: Starting Save Transient machine-id to Disk...754gitlab # [ 6.520438] systemd[1]: Starting Create System Files and Directories...755gitlab # [ 6.536134] systemd[1]: Condition check resulted in Virtio network device being skipped.756gitlab # [ 6.538171] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore757gitlab # [ 6.541637] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.758gitlab # [ 6.543766] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67759gitlab # [ 6.550730] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore760gitlab # [ 6.553203] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os761gitlab # [ 6.555675] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os762gitlab # [ 6.557457] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.763gitlab # [ 6.558792] systemd[1]: Finished Save Transient machine-id to Disk.764gitlab # [ 6.572152] systemd[1]: Finished Create System Files and Directories.765gitlab # [ 6.576209] systemd[1]: Starting Rebuild Journal Catalog...766gitlab # [ 6.579959] systemd[1]: Starting Record System Boot/Shutdown in UTMP...767gitlab # [ 6.612468] mousedev: PS/2 mouse device common for all mice768gitlab # [ 6.611526] systemd[1]: Finished Record System Boot/Shutdown in UTMP.769gitlab # [ 6.636203] systemd[1]: Finished Rebuild Journal Catalog.770gitlab # [ 6.639925] systemd[1]: Starting Update is Completed...771gitlab # [ 6.669915] systemd[1]: Finished Update is Completed.772gitlab # [ 6.703770] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.773gitlab # [ 6.706193] systemd[1]: Finished Create SUID/SGID Wrappers.774gitlab # [ 6.707071] systemd[1]: suid-sgid-wrappers.service: Consumed 134ms CPU time over 191ms wall clock time, 6.5M memory peak, 1.9M read from disk.775gitlab # [ 6.969268] systemd[1]: Finished register-nix-paths.service.776gitlab # [ 6.971409] systemd[1]: Reached target System Initialization.777gitlab # [ 6.972576] systemd[1]: Started Discard unused filesystem blocks once a week.778gitlab # [ 6.973624] systemd[1]: Started logrotate.timer.779gitlab # [ 6.974326] systemd[1]: Started Daily Cleanup of Temporary Directories.780gitlab # [ 6.975278] systemd[1]: Reached target Timer Units.781gitlab # [ 6.977593] systemd[1]: Listening on D-Bus System Message Bus Socket.782gitlab # [ 6.980123] systemd[1]: Listening on Nix Daemon Socket.783gitlab # [ 6.999602] systemd[1]: Starting nixbot CI service socket...784gitlab # [ 7.000653] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.785gitlab # [ 7.033212] systemd[1]: Starting D-Bus System Message Bus...786gitlab # [ 7.034319] systemd[1]: Listening on nixbot CI service socket.787gitlab # [ 7.035218] systemd[1]: Reached target Socket Units.788gitlab # [ 7.078282] dbus-broker-launch[565]: Looking up NSS user entry for 'systemd-timesync'...789gitlab # [ 7.082118] dbus-broker-launch[565]: NSS returned no entry for 'systemd-timesync'790gitlab # [ 7.083366] dbus-broker-launch[565]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"791gitlab # [ 7.089522] systemd[1]: Started D-Bus System Message Bus.792gitlab # [ 7.099569] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3793gitlab # [ 7.103148] dbus-broker-launch[565]: Ready794gitlab # [ 7.104999] systemd[1]: Reached target Basic System.795gitlab # [ 7.108526] systemd[1]: Started backdoor.service.796gitlab # [ 7.113632] systemd[1]: Starting gitlab-config.service...797gitlab # [ 7.136598] systemd[1]: Starting Import lastlog data into lastlog2 database...798gitlab # [ 7.141025] systemd[1]: Starting Logrotate configuration check...799gitlab # [ 7.153443] systemd[1]: Starting Name Service Cache Daemon (nsncd)...800gitlab # connecting to host...801gitlab # [ 7.159166] systemd[1]: Starting Post-Boot Actions...802gitlab # [ 7.168946] systemd[1]: Started Reset console on configuration changes.803gitlab # [ 7.177208] logrotate[573]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.804gitlab # [ 7.181446] logrotate[573]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf805gitlab # [ 7.184990] logrotate[573]: note: 'monthly' overrides previously specified 'weekly'806gitlab # [ 7.186164] logrotate[573]: Reading state from file: /var/lib/logrotate.status807gitlab: Guest shell says: b'Spawning backdoor root shell...\n'808gitlab # [ 7.187156] logrotate[573]: state file /var/lib/logrotate.status does not exist809gitlab # [ 7.188231] logrotate[573]: Allocating hash table for state file, size 64 entries810gitlab: connected to guest root shell811gitlab # [ 7.189176] logrotate[573]: Handling 4 logs812gitlab: (connecting took 7.67 seconds)813gitlab # [ 7.189766] logrotate[573]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed814gitlab: (finished: waiting for the VM to finish booting, in 7.67 seconds)815gitlab # [ 7.191674] logrotate[573]: considering log /var/log/btmp816gitlab # [ 7.192518] logrotate[573]: Creating new state817gitlab # [ 7.193113] logrotate[573]: Now: 2026-09-04 06:40818gitlab # [ 7.193762] logrotate[573]: Last rotated at 2026-09-04 06:00819gitlab # [ 7.194498] logrotate[573]: log does not need rotating (log has already been rotated)820gitlab # [ 7.195510] logrotate[573]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed821gitlab # [ 7.197666] logrotate[573]: considering log /var/log/wtmp822gitlab # [ 7.198350] logrotate[573]: Creating new state823gitlab # [ 7.198975] logrotate[573]: Now: 2026-09-04 06:40824gitlab # [ 7.199629] logrotate[573]: Last rotated at 2026-09-04 06:00825gitlab # [ 7.200408] logrotate[573]: log does not need rotating (log has already been rotated)826gitlab # [ 7.201374] logrotate[573]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed827gitlab # [ 7.203238] logrotate[573]: switching euid from 0 to 165 and egid from 0 to 165 (pid 573)828gitlab # [ 7.204657] logrotate[573]: considering log /var/gitlab/state/log/*.log829gitlab # [ 7.205599] logrotate[573]: log /var/gitlab/state/log/*.log does not exist -- skipping830gitlab # [ 7.206671] logrotate[573]: Creating new state831gitlab # [ 7.207438] logrotate[573]: switching euid from 165 to 0 and egid from 165 to 0 (pid 573)832gitlab # [ 7.208642] logrotate[573]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed833gitlab # [ 7.213861] logrotate[573]: switching euid from 0 to 60 and egid from 0 to 60 (pid 573)834gitlab # [ 7.214984] logrotate[573]: considering log /var/log/nginx/*.log835gitlab # [ 7.215809] logrotate[573]: log /var/log/nginx/*.log does not exist -- skipping836gitlab # [ 7.216882] logrotate[573]: Creating new state837gitlab # [ 7.217503] logrotate[573]: not running postrotate script, since no logs were rotated838gitlab # [ 7.218581] logrotate[573]: switching euid from 60 to 0 and egid from 60 to 0 (pid 573)839gitlab # [ 7.219791] systemd[1]: Starting resolvconf update...840gitlab # [ 7.221826] nsncd[574]: Sep 04 06:40:51.047 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"841gitlab # [ 7.224151] systemd[1]: Finished Logrotate configuration check.842gitlab # [ 7.225177] systemd[1]: Started Name Service Cache Daemon (nsncd).843gitlab # [ 7.226213] systemd[1]: Finished Post-Boot Actions.844gitlab # [ 7.227108] systemd[1]: Finished Import lastlog data into lastlog2 database.845gitlab # [ 7.253932] systemd[1]: Reached target Host and Network Name Lookups.846gitlab # [ 7.257265] systemd[1]: Reached target User and Group Name Lookups.847gitlab # [ 7.266255] systemd[1]: Starting User Login Management...848gitlab # [ 7.271450] systemd[1]: Starting Virtual Console Setup...849gitlab # [ 7.299353] systemd[1]: Stopped target Host and Network Name Lookups.850gitlab # [ 7.302548] systemd[1]: Stopping Host and Network Name Lookups...851gitlab # [ 7.303586] systemd[1]: Stopped target User and Group Name Lookups.852gitlab # [ 7.304646] systemd[1]: Stopping User and Group Name Lookups...853gitlab # [ 7.305598] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...854gitlab # [ 7.306774] systemd[1]: nscd.service: Deactivated successfully.855gitlab # [ 7.307869] systemd[1]: Stopped Name Service Cache Daemon (nsncd).856gitlab # [ 7.310719] systemd[1]: nscd.service: Consumed 35ms CPU time over 149ms wall clock time, 7.5M memory peak, 5.8M read from disk.857gitlab # [ 7.324858] systemd[1]: Starting Name Service Cache Daemon (nsncd)...858gitlab # [ 7.341520] systemd-logind[637]: New seat seat0.859gitlab # [ 7.345815] systemd-logind[637]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)860gitlab # [ 7.347189] systemd-logind[637]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)861gitlab # [ 7.348603] systemd-logind[637]: Watching system buttons on /dev/input/event0 (gpio-keys)862gitlab # [ 7.350189] systemd[1]: Started User Login Management.863gitlab # [ 7.354353] systemd-vconsole-setup[642]: Configuration of first virtual console was skipped, ignoring remaining ones.864gitlab # [ 7.364087] systemd[1]: Starting linger-users.service...865gitlab # [ 7.365031] systemd[1]: Finished Virtual Console Setup.866gitlab # [ 7.369442] systemd[1]: Finished resolvconf update.867gitlab # [ 7.373085] systemd[1]: Reached target Preparation for Network.868gitlab # [ 7.379067] nsncd[665]: Sep 04 06:40:51.221 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"869gitlab # [ 7.381425] systemd[1]: Starting DHCP Client...870gitlab # [ 7.384185] systemd[1]: Starting Address configuration of eth1...871gitlab # [ 7.388866] systemd[1]: Starting Extra networking commands....872gitlab # [ 7.403638] systemd[1]: Started Name Service Cache Daemon (nsncd).873gitlab # [ 7.405538] systemd[1]: linger-users.service: Deactivated successfully.874gitlab # [ 7.406664] systemd[1]: Finished linger-users.service.875gitlab # [ 7.412265] systemd[1]: Reached target Host and Network Name Lookups.876gitlab # [ 7.413301] systemd[1]: Reached target User and Group Name Lookups.877gitlab # [ 7.430391] network-addresses-eth1-start[693]: adding address 192.168.1.1/24... done878gitlab # [ 7.437994] network-addresses-eth1-start[693]: adding address 2001:db8:1::1/64... done879gitlab # [ 7.447650] systemd[1]: Finished Address configuration of eth1.880gitlab # [ 7.513438] systemd[1]: Finished Extra networking commands..881gitlab # [ 7.515256] systemd[1]: Reached target Network.882gitlab # [ 7.520208] systemd[1]: Starting gitlab-workhorse.service...883gitlab # [ 7.523780] systemd[1]: Starting Nginx Web Server...884gitlab # [ 7.530268] dhcpcd[709]: dhcpcd-10.3.2 starting885gitlab # [ 7.531677] systemd[1]: Starting PostgreSQL Server...886gitlab # [ 7.536552] dhcpcd[764]: dev: loaded udev887gitlab # [ 7.538415] systemd[1]: Starting Redis Server - redis-gitlab...888gitlab # [ 7.547376] systemd[1]: Starting Permit User Sessions...889gitlab # [ 7.554346] 8021q: 802.1Q VLAN Support v1.8890gitlab # [ 7.554809] 8021q: adding VLAN 0 to HW filter on device eth1891gitlab # [ 7.576335] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.892gitlab # [ 7.590121] systemd[1]: Finished Permit User Sessions.893gitlab # [ 7.607516] cfg80211: Loading compiled-in X.509 certificates for regulatory database894gitlab # [ 7.605659] systemd[1]: Started Getty on tty1.895gitlab # [ 7.607188] systemd[1]: Reached target Login Prompts.896gitlab # [ 7.616777] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'897gitlab # [ 7.618879] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'898gitlab # [ 7.622192] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2899gitlab # [ 7.622645] cfg80211: failed to load regulatory.db900gitlab # [ 7.668738] 8021q: adding VLAN 0 to HW filter on device eth0901gitlab # [ 7.665752] dhcpcd[764]: eth0: waiting for carrier902gitlab # [ 7.666783] dhcpcd[764]: eth0: carrier acquired903gitlab # [ 7.678709] dhcpcd[764]: DUID 00:01:00:01:32:2d:24:73:52:54:00:12:34:56904gitlab # [ 7.679866] dhcpcd[764]: eth0: IAID 00:12:34:56905gitlab # [ 7.684450] dhcpcd[764]: eth0: adding address fe80::5054:ff:fe12:3456906gitlab # [ 7.757697] nginx-pre-start[797]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok907gitlab # [ 7.759478] nginx-pre-start[797]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful908gitlab # [ 7.767046] systemd[1]: Started Nginx Web Server.909gitlab # [ 7.788547] redis-server[793]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.910gitlab # [ 7.791013] redis-server[793]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo911gitlab # [ 7.792381] redis-server[793]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=793, just started912gitlab # [ 7.794163] redis-server[793]: Configuration loaded913gitlab # [ 7.795286] redis[793]: monotonic clock: ARM CNTVCT @ 1000 ticks/us914gitlab # [ 7.796722] redis[793]: Running mode=standalone, port=0.915gitlab # [ 7.797702] systemd[1]: Started Redis Server - redis-gitlab.916gitlab # [ 7.798600] redis[793]: Server initialized917gitlab # [ 7.799400] redis[793]: Ready to accept connections unix918gitlab # [ 7.800617] redis[793]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.919gitlab # [ 7.817980] postgresql-pre-start[801]: The files belonging to this database system will be owned by user "postgres".920gitlab # [ 7.819648] postgresql-pre-start[801]: This user must also own the server process.921gitlab # [ 7.823945] postgresql-pre-start[801]: The database cluster will be initialized with locale "en_US.UTF-8".922gitlab # [ 7.825367] postgresql-pre-start[801]: The default database encoding has accordingly been set to "UTF8".923gitlab # [ 7.826705] postgresql-pre-start[801]: The default text search configuration will be set to "english".924gitlab # [ 7.827875] postgresql-pre-start[801]: Data page checksums are enabled.925gitlab # [ 7.828914] postgresql-pre-start[801]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok926gitlab # [ 7.830190] postgresql-pre-start[801]: creating subdirectories ... ok927gitlab # [ 7.831024] postgresql-pre-start[801]: selecting dynamic shared memory implementation ... posix928gitlab # [ 7.887525] postgresql-pre-start[801]: selecting default "max_connections" ... 100929gitlab # [ 7.955640] postgresql-pre-start[801]: selecting default "shared_buffers" ... 128MB930gitlab # [ 8.368245] systemd[1]: Started gitlab-workhorse.service.931gitlab # [ 8.654664] gitlab-workhorse[826]: time="2026-09-04T06:40:52Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4932gitlab # [ 8.660982] gitlab-workhorse[826]: time="2026-09-04T06:40:52Z" level=info msg="Using redis/go-redis"933gitlab # [ 8.665477] gitlab-workhorse[826]: time="2026-09-04T06:40:52Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix934gitlab # [ 8.680258] postgresql-pre-start[801]: selecting default time zone ... UTC935gitlab # [ 8.681463] postgresql-pre-start[801]: creating configuration files ... ok936gitlab # [ 8.854354] dhcpcd[764]: eth0: soliciting a DHCP lease937gitlab # [ 8.865139] dhcpcd[764]: eth0: offered 10.0.2.15 from 10.0.2.2938gitlab # [ 8.880800] dhcpcd[764]: eth0: probing address 10.0.2.15/24939gitlab # [ 8.999848] postgresql-pre-start[801]: running bootstrap script ... ok940gitlab # [ 9.730293] postgresql-pre-start[801]: performing post-bootstrap initialization ... ok941gitlab # [ 9.948742] dhcpcd[764]: eth0: soliciting an IPv6 router942gitlab # [ 9.951490] dhcpcd[764]: eth0: Router Advertisement from fe80::2943gitlab # [ 9.954558] dhcpcd[764]: eth0: adding address fec0::5054:ff:fe12:3456/64944gitlab # [ 9.957719] dhcpcd[764]: eth0: adding route to fec0::/64945gitlab # [ 9.960713] dhcpcd[764]: eth0: adding default route via fe80::2946gitlab # [ 10.046507] postgresql-pre-start[801]: syncing data to disk ... ok947gitlab # [ 10.049247] postgresql-pre-start[801]: initdb: warning: enabling "trust" authentication for local connections948gitlab # [ 10.053319] postgresql-pre-start[801]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.949gitlab # [ 10.059723] postgresql-pre-start[801]: Success. You can now start the database server using:950gitlab # [ 10.063320] postgresql-pre-start[801]: pg_ctl -D /var/lib/postgresql/18 -l logfile start951gitlab # [ 10.300595] postgres[856]: [856] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit952gitlab # [ 10.306647] postgres[856]: [856] LOG: listening on IPv6 address "::1", port 5432953gitlab # [ 10.310735] postgres[856]: [856] LOG: listening on IPv4 address "127.0.0.1", port 5432954gitlab # [ 10.315016] postgres[856]: [856] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"955gitlab # [ 10.319735] postgres[869]: [869] LOG: database system was shut down at 2026-09-04 06:40:53 GMT956gitlab # [ 10.324782] postgres[856]: [856] LOG: database system is ready to accept connections957gitlab # [ 10.328772] systemd[1]: Started PostgreSQL Server.958gitlab # [ 10.331088] systemd[1]: Starting PostgreSQL Setup Scripts...959gitlab # [ 10.525377] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[863]: mkdir -p /var/gitlab/state/home/.ssh: OK960gitlab # [ 10.531825] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[863]: chmod 700 /var/gitlab/state/home/.ssh: OK961gitlab # [ 10.599865] postgresql-setup-start[881]: CREATE DATABASE962gitlab # [ 10.628936] systemd[1]: Finished gitlab-config.service.963gitlab # [ 10.636304] systemd[1]: Started gitaly.service.964gitlab # [ 10.659321] postgresql-setup-start[907]: CREATE ROLE965gitlab # [ 10.684558] postgresql-setup-start[911]: ALTER DATABASE966gitlab # [ 10.740252] postgresql-setup-start[916]: CREATE ROLE967gitlab # [ 10.744646] systemd[1]: Finished PostgreSQL Setup Scripts.968gitlab # [ 10.746996] systemd[1]: Reached target PostgreSQL.969gitlab # [ 10.752188] systemd[1]: Starting gitlab-db-config.service...970gitlab # [ 10.756629] systemd[1]: Starting gitlab-postgresql.service...971gitlab # [ 10.986630] gitlab-postgresql-start[932]: CREATE DATABASE972gitlab # [ 11.056608] gitlab-postgresql-start[938]: CREATE EXTENSION973gitlab # [ 11.168427] gitlab-postgresql-start[940]: CREATE EXTENSION974gitlab # [ 11.169898] gitaly[908]: time="2026-09-04T06:40:55.011Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=908975gitlab # [ 11.180186] gitaly[908]: time="2026-09-04T06:40:55.012Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=908976gitlab # [ 11.181768] gitaly[908]: time="2026-09-04T06:40:55.012Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=908977gitlab # [ 11.188197] gitaly[908]: time="2026-09-04T06:40:55.012Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=908978gitlab # [ 11.189900] gitaly[908]: time="2026-09-04T06:40:55.012Z" level=info msg="Starting Gitaly" pid=908 version=979gitlab # [ 11.191217] systemd[1]: Finished gitlab-postgresql.service.980gitlab # [ 11.370977] gitaly[908]: time="2026-09-04T06:40:55.213Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=200 pid=908981gitlab # [ 11.372812] gitaly[908]: time="2026-09-04T06:40:55.213Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=908982gitlab # [ 11.374338] gitaly[908]: time="2026-09-04T06:40:55.214Z" level=info msg="finished initializing command factory" duration_ms=0 pid=908983gitlab # [ 11.376037] gitaly[908]: time="2026-09-04T06:40:55.214Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-908/git-exec-3216667038.d/git pid=908984gitlab # [ 11.378126] gitaly[908]: time="2026-09-04T06:40:55.220Z" level=info msg="finished detecting git version" duration_ms=6 pid=908985gitlab # [ 11.379593] gitaly[908]: time="2026-09-04T06:40:55.220Z" level=info msg="using Git version" pid=908 version=2.53.g986gitlab # [ 11.381159] gitaly[908]: time="2026-09-04T06:40:55.220Z" level=info msg="clearing disk cache object folder" pid=908 storage=default987gitlab # [ 11.382657] gitaly[908]: time="2026-09-04T06:40:55.220Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2513025508 pid=908 storage=default988gitlab # [ 11.385425] gitaly[908]: time="2026-09-04T06:40:55.220Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2513025508 pid=908 storage=default989gitlab # [ 11.388112] gitaly[908]: time="2026-09-04T06:40:55.220Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=908990gitlab # [ 11.390648] gitaly[908]: time="2026-09-04T06:40:55.220Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=908991gitlab # [ 11.393681] gitaly[908]: time="2026-09-04T06:40:55.221Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2513025508 clear_duration_ms=0 pid=908 storage=default992gitlab # [ 11.396675] gitaly[908]: time="2026-09-04T06:40:55.238Z" level=info msg="counting repositories" pid=908993gitlab # [ 11.397924] gitaly[908]: time="2026-09-04T06:40:55.238Z" level=info msg="starting to count repositories" pid=908 storage_path=/var/gitlab/state/repositories994gitlab # [ 11.399867] gitaly[908]: time="2026-09-04T06:40:55.238Z" level=info msg="finished tempdir cleaner walk" pid=908 storage=default time_ms=0995gitlab # [ 11.401779] gitaly[908]: time="2026-09-04T06:40:55.238Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=908996gitlab # [ 11.403764] gitaly[908]: time="2026-09-04T06:40:55.238Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=908 storage_path=/var/gitlab/state/repositories997gitlab # [ 11.405883] gitaly[908]: time="2026-09-04T06:40:55.238Z" level=info msg="completed counting all repositories" counting_duration=0 pid=908998gitlab # [ 11.407415] gitaly[908]: time="2026-09-04T06:40:55.238Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=908 schema=unix999gitlab # [ 11.409355] gitaly[908]: time="2026-09-04T06:40:55.238Z" level=info msg="listening at address" address=/run/gitaly/gitaly-908/sock.d/intern pid=908 schema=unix1000gitlab # [ 11.411129] gitaly[908]: time="2026-09-04T06:40:55.239Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9081001gitlab # [ 11.412711] gitaly[908]: time="2026-09-04T06:40:55.239Z" level=info msg="Started Gitaly" duration_ms=227 pid=9081002gitlab # [ 11.414003] gitaly[908]: time="2026-09-04T06:40:55.240Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9081003gitlab # [ 11.415526] gitaly[908]: time="2026-09-04T06:40:55.240Z" level=info msg="maintenance: daily scheduled" pid=908 scheduled="2026-09-04 12:00:00 +0000 UTC"1004gitlab # [ 12.050763] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1005gitlab # [ 12.051103] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1006gitlab # [ 12.066642] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1007gitlab # [ 13.008708] dhcpcd[764]: eth0: leased 10.0.2.15 for 86400 seconds1008gitlab # [ 13.009792] dhcpcd[764]: eth0: adding route to 10.0.2.0/241009gitlab # [ 13.010552] dhcpcd[764]: eth0: adding default route via 10.0.2.21010gitlab # [ 13.166067] systemd[1]: Started DHCP Client.1011gitlab # [ 13.167459] systemd[1]: Reached target Network is Online.1012gitlab # [ 14.812857] gitaly[908]: time="2026-09-04T06:40:58.654Z" level=info msg="License database preloaded" duration_ms=3641 pid=9081013gitlab # [ 57.293479] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[926]: W, [2026-09-04T06:41:41.134935 #926] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1014gitlab # [ 58.739925] gitlab-workhorse[826]: time="2026-09-04T06:41:42Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1015gitlab # [ 60.274080] postgres[1441]: [1441] ERROR: relation "feature_gates" does not exist at character 5231016gitlab # [ 60.274491] postgres[1441]: [1441] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1017gitlab # [ 60.274632] postgres[1441]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1018gitlab # [ 60.274756] postgres[1441]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1019gitlab # [ 60.274868] postgres[1441]: attidentity AS identity,1020gitlab # [ 60.275002] postgres[1441]: attgenerated as attgenerated1021gitlab # [ 60.275114] postgres[1441]: FROM pg_attribute a1022gitlab # [ 60.275255] postgres[1441]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1023gitlab # [ 60.275371] postgres[1441]: LEFT JOIN pg_type t ON a.atttypid = t.oid1024gitlab # [ 60.275484] postgres[1441]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1025gitlab # [ 60.275597] postgres[1441]: WHERE a.attrelid = '"feature_gates"'::regclass1026gitlab # [ 60.275694] postgres[1441]: AND a.attnum > 0 AND NOT a.attisdropped1027gitlab # [ 60.275803] postgres[1441]: ORDER BY a.attnum1028gitlab # [ 60.275900] postgres[1441]:1029gitlab # [ 65.437517] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1492]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1030gitlab # [ 65.437867] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1492]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1031gitlab # [ 68.750744] gitlab-workhorse[826]: time="2026-09-04T06:41:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1032gitlab # [ 78.755282] gitlab-workhorse[826]: time="2026-09-04T06:42:02Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1033gitlab # [ 88.762712] gitlab-workhorse[826]: time="2026-09-04T06:42:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1034gitlab # [ 92.444244] postgres[1595]: [1595] ERROR: relation "table_without_models" does not exist1035gitlab # [ 92.447604] postgres[1595]: [1595] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1036gitlab # [ 98.767376] gitlab-workhorse[826]: time="2026-09-04T06:42:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1037gitlab # [ 108.778256] gitlab-workhorse[826]: time="2026-09-04T06:42:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 118.788977] gitlab-workhorse[826]: time="2026-09-04T06:42:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 122.412835] systemd[1]: Finished gitlab-db-config.service.1040gitlab # [ 122.418922] systemd[1]: Started gitlab-sidekiq.service.1041gitlab # [ 122.423962] systemd[1]: Starting gitlab.service...1042gitlab # [ 122.990116] bundle[1979]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1043gitlab # [ 122.996539] bundle[1979]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1044gitlab # [ 123.002377] bundle[1979]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1045gitlab # [ 127.635478] sidekiq-cluster[1978]: {"severity":"INFO","time":"2026-09-04T06:42:51.436Z","message":"Starting cluster with 1 processes"}1046gitlab # [ 127.754903] bundle[1979]: {"timestamp":"2026-09-04T06:42:51.567Z","pid":1979,"message":"* Enabling systemd notification integration"}1047gitlab # [ 127.759955] bundle[1979]: {"timestamp":"2026-09-04T06:42:51.596Z","pid":1979,"message":"Puma starting in cluster mode..."}1048gitlab # [ 127.764295] bundle[1979]: {"timestamp":"2026-09-04T06:42:51.596Z","pid":1979,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1049gitlab # [ 127.768957] bundle[1979]: {"timestamp":"2026-09-04T06:42:51.596Z","pid":1979,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1050gitlab # [ 127.774703] bundle[1979]: {"timestamp":"2026-09-04T06:42:51.596Z","pid":1979,"message":"* Min threads: 0"}1051gitlab # [ 127.778655] bundle[1979]: {"timestamp":"2026-09-04T06:42:51.596Z","pid":1979,"message":"* Max threads: 4"}1052gitlab # [ 127.782663] bundle[1979]: {"timestamp":"2026-09-04T06:42:51.596Z","pid":1979,"message":"* Environment: production"}1053gitlab # [ 127.786879] bundle[1979]: {"timestamp":"2026-09-04T06:42:51.596Z","pid":1979,"message":"* Master PID: 1979"}1054gitlab # [ 127.790912] bundle[1979]: {"timestamp":"2026-09-04T06:42:51.596Z","pid":1979,"message":"* Workers: 2"}1055gitlab # [ 127.794941] bundle[1979]: {"timestamp":"2026-09-04T06:42:51.596Z","pid":1979,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1056gitlab # [ 127.799995] bundle[1979]: {"timestamp":"2026-09-04T06:42:51.596Z","pid":1979,"message":"* Preloading application"}1057gitlab # [ 128.792976] gitlab-workhorse[826]: time="2026-09-04T06:42:52Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1058gitlab # [ 138.807412] gitlab-workhorse[826]: time="2026-09-04T06:43:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1059gitlab # [ 148.810391] gitlab-workhorse[826]: time="2026-09-04T06:43:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1060gitlab # [ 158.820655] gitlab-workhorse[826]: time="2026-09-04T06:43:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1061gitlab # [ 166.231170] bundle[1979]: W, [2026-09-04T06:43:30.072746 #1979] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1062gitlab # [ 168.830145] gitlab-workhorse[826]: time="2026-09-04T06:43:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 170.415689] sidekiq-cluster[2023]: 2026-09-04T06:43:34.257Z pid=2023 tid=wnj INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2023, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>427937792}1064gitlab # [ 170.690261] sidekiq-cluster[2023]: W, [2026-09-04T06:43:34.532741 #2023] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1065gitlab # [ 170.835365] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:34.677Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1066gitlab # [ 174.089389] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:37.930Z","message":"GitLab reliable fetch activated!"}1067gitlab # [ 174.089798] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:37.931Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1068gitlab # [ 174.137748] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:37.980Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1069gitlab # [ 174.144841] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:37.986Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1070gitlab # [ 174.151827] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:37.992Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1071gitlab # [ 174.159546] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:37.998Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1072gitlab # [ 174.172609] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.002Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1073gitlab # [ 174.179201] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.007Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1074gitlab # [ 174.185505] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.011Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1075gitlab # [ 174.192244] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.015Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1076gitlab # [ 174.196923] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.018Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1077gitlab # [ 174.201183] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.022Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1078gitlab # [ 174.205641] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.024Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1079gitlab # [ 174.210423] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.028Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1080gitlab # [ 174.214001] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.031Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1081gitlab # [ 174.217738] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.034Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1082gitlab # [ 174.221239] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.036Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1083gitlab # [ 174.224722] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.039Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1084gitlab # [ 174.232090] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.042Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1085gitlab # [ 174.235341] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.046Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1086gitlab # [ 174.239077] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.048Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1087gitlab # [ 174.242550] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.051Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1088gitlab # [ 174.246462] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.054Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1089gitlab # [ 174.250900] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.057Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1090gitlab # [ 174.254276] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.059Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1091gitlab # [ 174.257552] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.061Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1092gitlab # [ 174.260693] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.064Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1093gitlab # [ 174.263548] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.067Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1094gitlab # [ 174.266504] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.070Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1095gitlab # [ 174.269392] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.073Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1096gitlab # [ 174.272071] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.076Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1097gitlab # [ 174.274761] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.078Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1098gitlab # [ 174.277340] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.080Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1099gitlab # [ 174.280107] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.083Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1100gitlab # [ 174.282552] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.085Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1101gitlab # [ 174.285256] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.088Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1102gitlab # [ 174.287827] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.090Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1103gitlab # [ 174.290626] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.092Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1104gitlab # [ 174.293367] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.094Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1105gitlab # [ 174.295859] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.096Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1106gitlab # [ 174.298592] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.098Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1107gitlab # [ 174.301198] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.101Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1108gitlab # [ 174.303821] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.103Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1109gitlab # [ 174.306488] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.105Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1110gitlab # [ 174.309025] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.107Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1111gitlab # [ 174.311320] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.109Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1112gitlab # [ 174.313871] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.112Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1113gitlab # [ 174.316297] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.114Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1114gitlab # [ 174.318554] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.116Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1115gitlab # [ 174.320760] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.119Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1116gitlab # [ 174.322826] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.121Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1117gitlab # [ 174.324967] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.123Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1118gitlab # [ 174.327024] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.126Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1119gitlab # [ 174.329166] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.128Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1120gitlab # [ 174.331331] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.140Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1121gitlab # [ 174.333748] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.143Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1122gitlab # [ 174.335869] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.146Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1123gitlab # [ 174.338118] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.148Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1124gitlab # [ 174.340219] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.151Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1125gitlab # [ 174.342428] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.153Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1126gitlab # [ 174.344619] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.155Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1127gitlab # [ 174.346782] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.157Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1128gitlab # [ 174.348797] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.159Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1129gitlab # [ 174.350767] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.161Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1130gitlab # [ 174.396059] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.237Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1131gitlab # [ 174.399984] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.241Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1132gitlab # [ 174.404050] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.244Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1133gitlab # [ 174.407933] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.246Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1134gitlab # [ 174.411801] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.249Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1135gitlab # [ 174.415835] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.251Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1136gitlab # [ 174.419960] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.254Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1137gitlab # [ 174.423909] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.255Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1138gitlab # [ 174.427590] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.258Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1139gitlab # [ 174.431063] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.260Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1140gitlab # [ 174.434409] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.263Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1141gitlab # [ 174.437778] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.265Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1142gitlab # [ 174.440928] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.266Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1143gitlab # [ 174.443924] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.269Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1144gitlab # [ 174.446879] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.271Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1145gitlab # [ 174.449992] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.274Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1146gitlab # [ 174.452546] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.276Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1147gitlab # [ 174.454959] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.278Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1148gitlab # [ 174.457675] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.280Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1149gitlab # [ 174.460291] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.283Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1150gitlab # [ 174.462775] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.285Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1151gitlab # [ 174.465209] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.288Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1152gitlab # [ 174.467665] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.290Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1153gitlab # [ 174.470084] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.292Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1154gitlab # [ 174.472439] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.294Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1155gitlab # [ 174.474685] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.297Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1156gitlab # [ 174.477061] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.298Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1157gitlab # [ 174.479271] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.300Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1158gitlab # [ 174.481629] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.302Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1159gitlab # [ 174.483800] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.304Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1160gitlab # [ 174.486170] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.306Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1161gitlab # [ 174.488539] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.308Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1162gitlab # [ 174.490510] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.311Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1163gitlab # [ 174.492857] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.313Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1164gitlab # [ 174.495060] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.316Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1165gitlab # [ 174.497337] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.318Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1166gitlab # [ 174.499495] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.334Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1167gitlab # [ 174.501732] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.335Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1168gitlab # [ 174.503788] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.338Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1169gitlab # [ 174.506072] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.341Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1170gitlab # [ 174.508054] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.345Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1171gitlab # [ 174.510131] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.347Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1172gitlab # [ 174.512439] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.349Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1173gitlab # [ 174.514721] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.351Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1174gitlab # [ 174.516835] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.353Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1175gitlab # [ 174.519039] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.356Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1176gitlab # [ 174.521290] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:43:38.359Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1177gitlab # [ 178.831327] gitlab-workhorse[826]: time="2026-09-04T06:43:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1178gitlab # [ 188.841864] gitlab-workhorse[826]: time="2026-09-04T06:43:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1179gitlab # [ 198.852465] gitlab-workhorse[826]: time="2026-09-04T06:44:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1180gitlab # [ 208.862309] gitlab-workhorse[826]: time="2026-09-04T06:44:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1181gitlab # [ 212.592771] postgres[2738]: [2738] ERROR: relation "table_without_models" does not exist1182gitlab # [ 212.596350] postgres[2738]: [2738] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1183gitlab # [ 217.379987] postgres[2786]: [2786] ERROR: relation "table_without_models" does not exist1184gitlab # [ 217.380376] postgres[2786]: [2786] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1185gitlab # [ 217.486403] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:21.328Z","message":"Booted Rails 7.2.3.1 application in production environment"}1186gitlab # [ 217.489589] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:21.331Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1187gitlab # [ 217.491502] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:21.332Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1188gitlab # [ 217.500167] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:21.332Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1189gitlab # [ 217.502184] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:21.337Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1190gitlab # [ 218.878163] gitlab-workhorse[826]: time="2026-09-04T06:44:22Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1191gitlab # [ 220.965033] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:24.806Z","message":"Cleaning working queues"}1192gitlab # [ 220.967853] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:24.809Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"498812e1fa1b5a6850f8ce3d","created_at":"2026-09-04T06:42:45.650Z","trace_propagation_headers":{"sentry-trace":"fef5a554dd48413481916d70248fd15e-57632522e15a486d","baggage":"sentry-trace_id=fef5a554dd48413481916d70248fd15e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"28c34858c012441c5ea876955c104c65","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T06:42:45.661Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-498812e1fa1b5a6850f8ce3d: start","job_status":"start","queue_duration_s":99.148295,"scheduling_latency_s":99.148409}1193gitlab # [ 221.317076] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:25.158Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"498812e1fa1b5a6850f8ce3d","created_at":"2026-09-04T06:42:45.650Z","trace_propagation_headers":{"sentry-trace":"fef5a554dd48413481916d70248fd15e-57632522e15a486d","baggage":"sentry-trace_id=fef5a554dd48413481916d70248fd15e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"28c34858c012441c5ea876955c104c65","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T06:42:45.661Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-498812e1fa1b5a6850f8ce3d: done: 0.349265 sec","job_status":"done","queue_duration_s":99.148295,"scheduling_latency_s":99.148409,"redis_calls":29,"redis_duration_s":0.008623,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.00469,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002543,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00139,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.14808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1731683,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.349265,"completed_at":"2026-09-04T06:44:25.158Z","load_balancing_strategy":"primary","db_duration_s":0.10917,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1194gitlab # [ 225.613411] bundle[1979]: {"timestamp":"2026-09-04T06:44:29.455Z","pid":1979,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1195gitlab # [ 225.613752] bundle[1979]: {"timestamp":"2026-09-04T06:44:29.455Z","pid":1979,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1196gitlab # [ 225.613924] bundle[1979]: {"timestamp":"2026-09-04T06:44:29.455Z","pid":1979,"message":"! #\u003cThread:0x0000ea13aea0f828 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1197gitlab # [ 225.614084] bundle[1979]: {"timestamp":"2026-09-04T06:44:29.455Z","pid":1979,"message":"! #\u003cThread:0x0000ea13aec0dda0 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1198gitlab # [ 225.614183] bundle[1979]: {"timestamp":"2026-09-04T06:44:29.455Z","pid":1979,"message":"Use Ctrl-C to stop"}1199gitlab # [ 225.614286] bundle[1979]: {"timestamp":"2026-09-04T06:44:29.455Z","pid":1979,"message":"Sending status to systemd every 1.0 sec"}1200gitlab # [ 228.848081] bundle[1979]: {"timestamp":"2026-09-04T06:44:32.690Z","pid":1979,"message":"- Worker 1 (PID: 2916) booted in 3.17s, phase: 0"}1201gitlab # [ 228.852057] bundle[1979]: {"timestamp":"2026-09-04T06:44:32.694Z","pid":1979,"message":"- Worker 0 (PID: 2912) booted in 3.2s, phase: 0"}1202gitlab # [ 228.855628] systemd[1]: Started gitlab.service.1203gitlab # [ 228.856423] systemd[1]: Reached target Common target for all GitLab services..1204gitlab # [ 228.861035] systemd[1]: Starting setup-gitlab.service...1205gitlab # [ 228.890360] setup-gitlab-start[2967]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1206gitlab # [ 229.817613] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:44:33 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 8961207gitlab # [ 229.820452] setup-gitlab-start[2967]: + TOKEN=nixbot-test-token-of-20-chars1208gitlab # [ 229.826699] setup-gitlab-start[2967]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1209gitlab # [ 229.843155] runuser[2985]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1210gitlab # [ 230.397992] setup-gitlab-start[2986]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1211gitlab # [ 230.404539] setup-gitlab-start[2986]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1212gitlab # [ 230.410738] setup-gitlab-start[2986]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1213gitlab # [ 231.213863] setup-gitlab-start[2986]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1214gitlab # [ 231.214217] setup-gitlab-start[2986]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1215gitlab # [ 231.216592] setup-gitlab-start[2986]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1216gitlab # [ 235.574566] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:39.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"0dd059722f2c9afabb658d5d","created_at":"2026-09-04T06:44:39.203Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0fc4954ba980ce7d7aafd1eb5b20698","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.407Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-0dd059722f2c9afabb658d5d: start","job_status":"start","queue_duration_s":0.007609,"scheduling_latency_s":0.007662}1217gitlab # [ 235.970007] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:39.812Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1218gitlab # [ 236.078451] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:39.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"0dd059722f2c9afabb658d5d","created_at":"2026-09-04T06:44:39.203Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0fc4954ba980ce7d7aafd1eb5b20698","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.407Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-0dd059722f2c9afabb658d5d: done: 0.504737 sec","job_status":"done","queue_duration_s":0.007609,"scheduling_latency_s":0.007662,"redis_calls":10,"redis_duration_s":0.056822000000000004,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.011859,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.025836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.019127,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00482558,"duration_s":0.504737,"completed_at":"2026-09-04T06:44:39.920Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.124242,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1219gitlab # [ 236.162556] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:39.926Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"25c51d24730de5a02a7adf59","created_at":"2026-09-04T06:44:39.451Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7192bdb9f58ace4ec5f75cccbd4a6c52","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.477Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-25c51d24730de5a02a7adf59: start","job_status":"start","queue_duration_s":0.449658,"scheduling_latency_s":0.449707}1220gitlab # [ 236.674219] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:40.515Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"25c51d24730de5a02a7adf59","created_at":"2026-09-04T06:44:39.451Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7192bdb9f58ace4ec5f75cccbd4a6c52","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.477Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-25c51d24730de5a02a7adf59: done: 0.588434 sec","job_status":"done","queue_duration_s":0.449658,"scheduling_latency_s":0.449707,"redis_calls":16,"redis_duration_s":0.118687,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.031249,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.079011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.008427,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.121,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.121,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00470716,"duration_s":0.588434,"completed_at":"2026-09-04T06:44:40.514Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.176351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1221gitlab # [ 236.755409] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:40.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"62818ae9cb31a17dd2f7e118","created_at":"2026-09-04T06:44:39.493Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cff6175c17e48f1e0c9532a26a2d3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.526Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-62818ae9cb31a17dd2f7e118: start","job_status":"start","queue_duration_s":1.010631,"scheduling_latency_s":1.010691}1222gitlab # [ 237.000271] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:40.841Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"62818ae9cb31a17dd2f7e118","created_at":"2026-09-04T06:44:39.493Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cff6175c17e48f1e0c9532a26a2d3e1e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.526Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-62818ae9cb31a17dd2f7e118: done: 0.304187 sec","job_status":"done","queue_duration_s":1.010631,"scheduling_latency_s":1.010691,"redis_calls":10,"redis_duration_s":0.045422,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006097,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.034023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00391194,"duration_s":0.304187,"completed_at":"2026-09-04T06:44:40.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.060652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1223gitlab # [ 237.103513] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:40.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"35448156237e019a05340e2a","created_at":"2026-09-04T06:44:39.562Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37604da0ac71e3cbc4b5435ee19e5203","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.625Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-35448156237e019a05340e2a: start","job_status":"start","queue_duration_s":1.22655,"scheduling_latency_s":1.226599}1224gitlab # [ 238.158246] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:41.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"35448156237e019a05340e2a","created_at":"2026-09-04T06:44:39.562Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37604da0ac71e3cbc4b5435ee19e5203","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.625Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-35448156237e019a05340e2a: done: 1.147207 sec","job_status":"done","queue_duration_s":1.22655,"scheduling_latency_s":1.226599,"redis_calls":14,"redis_duration_s":0.048560000000000006,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.016761,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.020843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010956,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.101,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.054,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.295209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0043809,"exclusive_lock_hold_duration_s":0.7423483,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":1.147207,"completed_at":"2026-09-04T06:44:41.999Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.187427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1225gitlab # [ 238.164081] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:42.005Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d35dd757d006fdcb70456112","created_at":"2026-09-04T06:44:39.661Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98f1af19788af84383060173541d10ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T06:44:39.697Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d35dd757d006fdcb70456112: start","job_status":"start","queue_duration_s":2.307945,"scheduling_latency_s":2.307984}1226gitlab # [ 238.288730] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:42.131Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1227gitlab # [ 238.316457] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:42.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d35dd757d006fdcb70456112","created_at":"2026-09-04T06:44:39.661Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98f1af19788af84383060173541d10ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T06:44:39.697Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d35dd757d006fdcb70456112: done: 0.152985 sec","job_status":"done","queue_duration_s":2.307945,"scheduling_latency_s":2.307984,"redis_calls":10,"redis_duration_s":0.0055,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001315,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00138,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.087,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00141808,"duration_s":0.152985,"completed_at":"2026-09-04T06:44:42.158Z","load_balancing_strategy":"primary","db_duration_s":0.087229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 238.382821] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:42.225Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"44142cd0e0f98e415c19e0de","created_at":"2026-09-04T06:44:39.738Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d20c8c1335c7efc25210821da491f11","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.762Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-44142cd0e0f98e415c19e0de: start","job_status":"start","queue_duration_s":2.462553,"scheduling_latency_s":2.462577}1229gitlab # [ 238.471104] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:42.313Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1230gitlab # [ 238.517210] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:42.358Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"44142cd0e0f98e415c19e0de","created_at":"2026-09-04T06:44:39.738Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d20c8c1335c7efc25210821da491f11","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.762Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-44142cd0e0f98e415c19e0de: done: 0.133492 sec","job_status":"done","queue_duration_s":2.462553,"scheduling_latency_s":2.462577,"redis_calls":10,"redis_duration_s":0.014181,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003747,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007549,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002885,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00230292,"duration_s":0.133492,"completed_at":"2026-09-04T06:44:42.358Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001376,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 238.621244] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:42.463Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"f82976ee1ed8db64f286d2c6","created_at":"2026-09-04T06:44:39.785Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7df10491aae1282c634fbd5522a842f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.832Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-f82976ee1ed8db64f286d2c6: start","job_status":"start","queue_duration_s":2.63053,"scheduling_latency_s":2.630576}1232gitlab # [ 238.715298] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:42.556Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"f82976ee1ed8db64f286d2c6","created_at":"2026-09-04T06:44:39.785Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7df10491aae1282c634fbd5522a842f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:39.832Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-f82976ee1ed8db64f286d2c6: done: 0.09374 sec","job_status":"done","queue_duration_s":2.63053,"scheduling_latency_s":2.630576,"redis_calls":12,"redis_duration_s":0.027402000000000003,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005015,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012455,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009932,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0020818,"exclusive_lock_hold_duration_s":0.00996302,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.09374,"completed_at":"2026-09-04T06:44:42.556Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 238.809362] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:42.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"f7c6ef96353ef4f4006deec7","created_at":"2026-09-04T06:44:39.892Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a97fd9298d1d5a955b05d4e250e7e58","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.028Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-f7c6ef96353ef4f4006deec7: start","job_status":"start","queue_duration_s":2.53303,"scheduling_latency_s":2.533069}1234gitlab # [ 238.827763] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:42.650Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"f7c6ef96353ef4f4006deec7","created_at":"2026-09-04T06:44:39.892Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a97fd9298d1d5a955b05d4e250e7e58","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.028Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-f7c6ef96353ef4f4006deec7: done: 0.089347 sec","job_status":"done","queue_duration_s":2.53303,"scheduling_latency_s":2.533069,"redis_calls":10,"redis_duration_s":0.004264,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001819,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000709,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005493,"duration_s":0.089347,"completed_at":"2026-09-04T06:44:42.650Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01809,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 238.881715] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:42.656Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5b37318553db44c21d106447","created_at":"2026-09-04T06:44:40.045Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"931ffbcec5b7e26d3268995fdbb7df02","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.076Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5b37318553db44c21d106447: start","job_status":"start","queue_duration_s":2.579765,"scheduling_latency_s":2.579809}1236gitlab # [ 239.679765] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:43.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5b37318553db44c21d106447","created_at":"2026-09-04T06:44:40.045Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"931ffbcec5b7e26d3268995fdbb7df02","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.076Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5b37318553db44c21d106447: done: 0.864633 sec","job_status":"done","queue_duration_s":2.579765,"scheduling_latency_s":2.579809,"redis_calls":14,"redis_duration_s":0.0073620000000000005,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003976,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001626,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.156,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.156,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.484605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00135968,"exclusive_lock_hold_duration_s":0.79722506,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.864633,"completed_at":"2026-09-04T06:44:43.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.399901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 239.680634] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:43.523Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"19eb642d54e28c7de88e66c7","created_at":"2026-09-04T06:44:40.102Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f24db858240170d28a57c1d3050611e3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T06:44:40.149Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-19eb642d54e28c7de88e66c7: start","job_status":"start","queue_duration_s":3.373012,"scheduling_latency_s":3.373041}1238gitlab # [ 239.793757] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:43.627Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1239gitlab # [ 239.805606] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:43.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"19eb642d54e28c7de88e66c7","created_at":"2026-09-04T06:44:40.102Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f24db858240170d28a57c1d3050611e3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T06:44:40.149Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-19eb642d54e28c7de88e66c7: done: 0.124298 sec","job_status":"done","queue_duration_s":3.373012,"scheduling_latency_s":3.373041,"redis_calls":10,"redis_duration_s":0.003511,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000675,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000667,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.084,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.084,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00073912,"duration_s":0.124298,"completed_at":"2026-09-04T06:44:43.647Z","load_balancing_strategy":"primary","db_duration_s":0.083508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1240gitlab # [ 239.866360] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:43.650Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"707f761519b53adcf02c8a66","created_at":"2026-09-04T06:44:40.178Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2944c5a152d57e10f7d8648a5c4c45ec","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.219Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-707f761519b53adcf02c8a66: start","job_status":"start","queue_duration_s":3.431352,"scheduling_latency_s":3.431397}1241gitlab # [ 240.187505] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"707f761519b53adcf02c8a66","created_at":"2026-09-04T06:44:40.178Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2944c5a152d57e10f7d8648a5c4c45ec","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.219Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-707f761519b53adcf02c8a66: done: 0.379407 sec","job_status":"done","queue_duration_s":3.431352,"scheduling_latency_s":3.431397,"redis_calls":565,"redis_duration_s":0.08191699999999999,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001418,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.079952,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.328502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030408,"duration_s":0.379407,"completed_at":"2026-09-04T06:44:44.029Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001973,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1242gitlab # [ 240.252917] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"edddf38e60ba266e0acffd26","created_at":"2026-09-04T06:44:40.262Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f7c115370c5aeebfd9bb81d77b2b43a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.311Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-edddf38e60ba266e0acffd26: start","job_status":"start","queue_duration_s":3.719705,"scheduling_latency_s":3.719726}1243gitlab # [ 240.268392] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.045Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1244gitlab # [ 240.271790] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.053Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"edddf38e60ba266e0acffd26","created_at":"2026-09-04T06:44:40.262Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f7c115370c5aeebfd9bb81d77b2b43a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.311Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-edddf38e60ba266e0acffd26: done: 0.021736 sec","job_status":"done","queue_duration_s":3.719705,"scheduling_latency_s":3.719726,"redis_calls":10,"redis_duration_s":0.001497,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000333,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000321,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024766,"duration_s":0.021736,"completed_at":"2026-09-04T06:44:44.053Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 240.314955] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"626d57f9f1dcf24be582047f","created_at":"2026-09-04T06:44:40.344Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6193d2af624c0cde3846c50fb6df1a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.381Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-626d57f9f1dcf24be582047f: start","job_status":"start","queue_duration_s":3.673003,"scheduling_latency_s":3.67302}1246gitlab # [ 240.329004] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"626d57f9f1dcf24be582047f","created_at":"2026-09-04T06:44:40.344Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6193d2af624c0cde3846c50fb6df1a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.381Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-626d57f9f1dcf24be582047f: done: 0.030885 sec","job_status":"done","queue_duration_s":3.673003,"scheduling_latency_s":3.67302,"redis_calls":12,"redis_duration_s":0.001758,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000741,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00052298,"exclusive_lock_hold_duration_s":0.00970652,"duration_s":0.030885,"completed_at":"2026-09-04T06:44:44.085Z","load_balancing_strategy":"primary","db_duration_s":0.00564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 240.370169] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.086Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"de808be15b717d2f481109e6","created_at":"2026-09-04T06:44:40.483Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e030e1228925036670ced1a3fd352821","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.533Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-de808be15b717d2f481109e6: start","job_status":"start","queue_duration_s":3.553709,"scheduling_latency_s":3.553726}1248gitlab # [ 240.384285] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"de808be15b717d2f481109e6","created_at":"2026-09-04T06:44:40.483Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e030e1228925036670ced1a3fd352821","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.533Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-de808be15b717d2f481109e6: done: 0.028934 sec","job_status":"done","queue_duration_s":3.553709,"scheduling_latency_s":3.553726,"redis_calls":12,"redis_duration_s":0.003509,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00238,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003654,"duration_s":0.028934,"completed_at":"2026-09-04T06:44:44.115Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249gitlab # [ 240.425568] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"504be2c1cab6cbc2b9ff0d63","created_at":"2026-09-04T06:44:40.561Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfbc634590c346b020b8a30671a58715","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.592Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-504be2c1cab6cbc2b9ff0d63: start","job_status":"start","queue_duration_s":3.524175,"scheduling_latency_s":3.524192}1250gitlab # [ 240.438723] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.157Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"504be2c1cab6cbc2b9ff0d63","created_at":"2026-09-04T06:44:40.561Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfbc634590c346b020b8a30671a58715","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.592Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-504be2c1cab6cbc2b9ff0d63: done: 0.040534 sec","job_status":"done","queue_duration_s":3.524175,"scheduling_latency_s":3.524192,"redis_calls":19,"redis_duration_s":0.004007999999999999,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000622,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000214,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002361,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000811,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023784,"duration_s":0.040534,"completed_at":"2026-09-04T06:44:44.157Z","load_balancing_strategy":"primary","db_duration_s":0.003837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 240.480404] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.159Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d0785b0742c0aaf7ef503b61","created_at":"2026-09-04T06:44:40.613Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68e18914aa6bdf67a0942617c09aee0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.642Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d0785b0742c0aaf7ef503b61: start","job_status":"start","queue_duration_s":3.516406,"scheduling_latency_s":3.516423}1252gitlab # [ 240.494711] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.207Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d0785b0742c0aaf7ef503b61","created_at":"2026-09-04T06:44:40.613Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68e18914aa6bdf67a0942617c09aee0e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.642Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d0785b0742c0aaf7ef503b61: done: 0.048679 sec","job_status":"done","queue_duration_s":3.516406,"scheduling_latency_s":3.516423,"redis_calls":12,"redis_duration_s":0.001686,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000672,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00053214,"exclusive_lock_hold_duration_s":0.02100988,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.048679,"completed_at":"2026-09-04T06:44:44.207Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1253gitlab # [ 240.539541] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.209Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f93b32e1344a0ce2390157cd","created_at":"2026-09-04T06:44:40.686Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8102d30e2e70df91778724fb9ed54bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.738Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f93b32e1344a0ce2390157cd: start","job_status":"start","queue_duration_s":3.47019,"scheduling_latency_s":3.470207}1254gitlab # [ 240.553620] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.226Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f93b32e1344a0ce2390157cd","created_at":"2026-09-04T06:44:40.686Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8102d30e2e70df91778724fb9ed54bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.738Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f93b32e1344a0ce2390157cd: done: 0.017366 sec","job_status":"done","queue_duration_s":3.47019,"scheduling_latency_s":3.470207,"redis_calls":10,"redis_duration_s":0.0012439999999999999,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022898,"duration_s":0.017366,"completed_at":"2026-09-04T06:44:44.226Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 240.595216] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.227Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"08c25933255c80f8ce959e29","created_at":"2026-09-04T06:44:40.770Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44ea4aa6ffac6264266e22de7e7ebedc","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.818Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-08c25933255c80f8ce959e29: start","job_status":"start","queue_duration_s":3.409052,"scheduling_latency_s":3.409069}1256gitlab # [ 240.608363] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.245Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"08c25933255c80f8ce959e29","created_at":"2026-09-04T06:44:40.770Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44ea4aa6ffac6264266e22de7e7ebedc","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.818Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-08c25933255c80f8ce959e29: done: 0.018163 sec","job_status":"done","queue_duration_s":3.409052,"scheduling_latency_s":3.409069,"redis_calls":12,"redis_duration_s":0.001579,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000366,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229,"duration_s":0.018163,"completed_at":"2026-09-04T06:44:44.245Z","load_balancing_strategy":"primary","db_duration_s":0.000699,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 240.649586] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.246Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"64059caa1a525fb43f48f5e4","created_at":"2026-09-04T06:44:40.845Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56eb3682ea93e6780329e48773f3a9ea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.886Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-64059caa1a525fb43f48f5e4: start","job_status":"start","queue_duration_s":3.360783,"scheduling_latency_s":3.360799}1258gitlab # [ 240.663751] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.257Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1259gitlab # [ 240.667458] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.263Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"64059caa1a525fb43f48f5e4","created_at":"2026-09-04T06:44:40.845Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56eb3682ea93e6780329e48773f3a9ea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.886Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-64059caa1a525fb43f48f5e4: done: 0.016931 sec","job_status":"done","queue_duration_s":3.360783,"scheduling_latency_s":3.360799,"redis_calls":10,"redis_duration_s":0.0012569999999999999,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024306,"duration_s":0.016931,"completed_at":"2026-09-04T06:44:44.263Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 240.709421] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8d0a5491ab26b356859079cb","created_at":"2026-09-04T06:44:40.952Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d52a0dc76242f1246169b179fb3e0d87","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.984Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8d0a5491ab26b356859079cb: start","job_status":"start","queue_duration_s":3.280026,"scheduling_latency_s":3.280043}1261gitlab # [ 240.723887] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8d0a5491ab26b356859079cb","created_at":"2026-09-04T06:44:40.952Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d52a0dc76242f1246169b179fb3e0d87","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:40.984Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8d0a5491ab26b356859079cb: done: 0.045826 sec","job_status":"done","queue_duration_s":3.280026,"scheduling_latency_s":3.280043,"redis_calls":10,"redis_duration_s":0.00137,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025578,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.045826,"completed_at":"2026-09-04T06:44:44.310Z","load_balancing_strategy":"primary","db_duration_s":0.024833,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 240.765924] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"a186eb989edfffb23256dde1","created_at":"2026-09-04T06:44:41.023Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:41.073Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-a186eb989edfffb23256dde1: start","job_status":"start","queue_duration_s":3.238088,"scheduling_latency_s":3.238106}1263gitlab # [ 240.779832] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"a186eb989edfffb23256dde1","created_at":"2026-09-04T06:44:41.023Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:41.073Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-a186eb989edfffb23256dde1: done: 0.052329 sec","job_status":"done","queue_duration_s":3.238088,"scheduling_latency_s":3.238106,"redis_calls":28,"redis_duration_s":0.004195,"redis_read_bytes":36,"redis_write_bytes":10593,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000826,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000372,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8305,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.002202,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024952,"duration_s":0.052329,"completed_at":"2026-09-04T06:44:44.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007002,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 240.822513] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.365Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2073519a6e4546e74a46ab9a","created_at":"2026-09-04T06:44:41.116Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:41.159Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2073519a6e4546e74a46ab9a: start","job_status":"start","queue_duration_s":3.20577,"scheduling_latency_s":3.205786}1265gitlab # [ 240.835794] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2073519a6e4546e74a46ab9a","created_at":"2026-09-04T06:44:41.116Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:41.159Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2073519a6e4546e74a46ab9a: done: 0.104719 sec","job_status":"done","queue_duration_s":3.20577,"scheduling_latency_s":3.205786,"redis_calls":71,"redis_duration_s":0.010034000000000001,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001329,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000775,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.007518,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002384,"duration_s":0.104719,"completed_at":"2026-09-04T06:44:44.469Z","load_balancing_strategy":"primary","db_duration_s":0.003012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 240.877822] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.471Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"18bf9a5f13df906ad2260057","created_at":"2026-09-04T06:44:41.215Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"1a31d679753bb6830e08fcf5039872ca","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:41.274Z","job_size_bytes":3,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-18bf9a5f13df906ad2260057: start","job_status":"start","queue_duration_s":3.196274,"scheduling_latency_s":3.196291}1267gitlab # [ 240.891429] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.489Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"18bf9a5f13df906ad2260057","created_at":"2026-09-04T06:44:41.215Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"1a31d679753bb6830e08fcf5039872ca","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:41.274Z","job_size_bytes":3,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-18bf9a5f13df906ad2260057: done: 0.017913 sec","job_status":"done","queue_duration_s":3.196274,"scheduling_latency_s":3.196291,"redis_calls":10,"redis_duration_s":0.001295,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025872,"duration_s":0.017913,"completed_at":"2026-09-04T06:44:44.488Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 240.933439] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e5620f1f3fc8335896a569c1","created_at":"2026-09-04T06:44:41.315Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91985fad04063e12f4997a67276da5c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T06:44:41.356Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e5620f1f3fc8335896a569c1: start","job_status":"start","queue_duration_s":3.133254,"scheduling_latency_s":3.13327}1269gitlab # [ 240.946113] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e5620f1f3fc8335896a569c1","created_at":"2026-09-04T06:44:41.315Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91985fad04063e12f4997a67276da5c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T06:44:41.356Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e5620f1f3fc8335896a569c1: done: 0.031892 sec","job_status":"done","queue_duration_s":3.133254,"scheduling_latency_s":3.13327,"redis_calls":10,"redis_duration_s":0.001327,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000312,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023494,"duration_s":0.031892,"completed_at":"2026-09-04T06:44:44.521Z","load_balancing_strategy":"primary","db_duration_s":0.00673,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1270gitlab # [ 240.986169] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.523Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dc25f17a404a966ecc984d88","created_at":"2026-09-04T06:44:41.393Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e29179e4dee0372a860382b6cbb46056","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:41.444Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dc25f17a404a966ecc984d88: start","job_status":"start","queue_duration_s":3.078535,"scheduling_latency_s":3.078553}1271gitlab # [ 241.000212] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.553Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dc25f17a404a966ecc984d88","created_at":"2026-09-04T06:44:41.393Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e29179e4dee0372a860382b6cbb46056","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:41.444Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dc25f17a404a966ecc984d88: done: 0.030605 sec","job_status":"done","queue_duration_s":3.078535,"scheduling_latency_s":3.078553,"redis_calls":13,"redis_duration_s":0.0018340000000000001,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00064,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01086486,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.030605,"completed_at":"2026-09-04T06:44:44.553Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004396,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1272gitlab # [ 241.043288] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.554Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"7f237b173fc4bcdc7b4983d6","created_at":"2026-09-04T06:44:41.471Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"092c30bac53a2b2b7d5a8e395507ca72","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:41.514Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-7f237b173fc4bcdc7b4983d6: start","job_status":"start","queue_duration_s":3.040281,"scheduling_latency_s":3.040297}1273gitlab # [ 241.057692] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.578Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"7f237b173fc4bcdc7b4983d6","created_at":"2026-09-04T06:44:41.471Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"092c30bac53a2b2b7d5a8e395507ca72","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T06:44:41.514Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-7f237b173fc4bcdc7b4983d6: done: 0.023525 sec","job_status":"done","queue_duration_s":3.040281,"scheduling_latency_s":3.040297,"redis_calls":12,"redis_duration_s":0.001558,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0007,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045214,"exclusive_lock_hold_duration_s":0.006224540000000001,"duration_s":0.023525,"completed_at":"2026-09-04T06:44:44.578Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 241.099193] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.579Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"44f3a15b7fe7922b9c550e32","created_at":"2026-09-04T06:44:44.135Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-b2562c1280034cf2","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cfbc634590c346b020b8a30671a58715","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.149Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-44f3a15b7fe7922b9c550e32: start","job_status":"start","queue_duration_s":0.430154,"scheduling_latency_s":0.43017}1275gitlab # [ 241.111270] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.595Z","message":"No existing merge request to be cleaned up."}1276gitlab # [ 241.112919] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.608Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"44f3a15b7fe7922b9c550e32","created_at":"2026-09-04T06:44:44.135Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-b2562c1280034cf2","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cfbc634590c346b020b8a30671a58715","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.149Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-44f3a15b7fe7922b9c550e32: done: 0.028628 sec","job_status":"done","queue_duration_s":0.430154,"scheduling_latency_s":0.43017,"redis_calls":13,"redis_duration_s":0.001892,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024106,"duration_s":0.028628,"completed_at":"2026-09-04T06:44:44.608Z","load_balancing_strategy":"primary","db_duration_s":0.005229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 241.153243] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.609Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c740a42dd13cf8ae54f1a4ee","created_at":"2026-09-04T06:44:44.135Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-b2562c1280034cf2","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cfbc634590c346b020b8a30671a58715","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.149Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c740a42dd13cf8ae54f1a4ee: start","job_status":"start","queue_duration_s":0.459885,"scheduling_latency_s":0.459901}1278gitlab # [ 241.165702] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.619Z","message":"No existing merge request to be cleaned up."}1279gitlab # [ 241.167390] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.627Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c740a42dd13cf8ae54f1a4ee","created_at":"2026-09-04T06:44:44.135Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-b2562c1280034cf2","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cfbc634590c346b020b8a30671a58715","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.149Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c740a42dd13cf8ae54f1a4ee: done: 0.018088 sec","job_status":"done","queue_duration_s":0.459885,"scheduling_latency_s":0.459901,"redis_calls":10,"redis_duration_s":0.0012950000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00075,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018088,"completed_at":"2026-09-04T06:44:44.627Z","load_balancing_strategy":"primary","db_duration_s":0.002296,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 241.205775] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.628Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"986d5cc83e1994d6070eaace","created_at":"2026-09-04T06:44:44.135Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-b2562c1280034cf2","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cfbc634590c346b020b8a30671a58715","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.149Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-986d5cc83e1994d6070eaace: start","job_status":"start","queue_duration_s":0.479046,"scheduling_latency_s":0.479062}1281gitlab # [ 241.217998] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.638Z","message":"No existing merge request to be cleaned up."}1282gitlab # [ 241.219636] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.646Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"986d5cc83e1994d6070eaace","created_at":"2026-09-04T06:44:44.135Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-b2562c1280034cf2","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cfbc634590c346b020b8a30671a58715","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.149Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-986d5cc83e1994d6070eaace: done: 0.018338 sec","job_status":"done","queue_duration_s":0.479046,"scheduling_latency_s":0.479062,"redis_calls":10,"redis_duration_s":0.001321,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018338,"completed_at":"2026-09-04T06:44:44.646Z","load_balancing_strategy":"primary","db_duration_s":0.002318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 241.257662] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.648Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6bcfdb87864ebed184489a88","created_at":"2026-09-04T06:44:44.135Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-b2562c1280034cf2","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cfbc634590c346b020b8a30671a58715","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.149Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6bcfdb87864ebed184489a88: start","job_status":"start","queue_duration_s":0.49859,"scheduling_latency_s":0.498607}1284gitlab # [ 241.269867] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.657Z","message":"No existing merge request to be cleaned up."}1285gitlab # [ 241.271506] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.665Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6bcfdb87864ebed184489a88","created_at":"2026-09-04T06:44:44.135Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-b2562c1280034cf2","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cfbc634590c346b020b8a30671a58715","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.149Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6bcfdb87864ebed184489a88: done: 0.017675 sec","job_status":"done","queue_duration_s":0.49859,"scheduling_latency_s":0.498607,"redis_calls":10,"redis_duration_s":0.0012590000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017675,"completed_at":"2026-09-04T06:44:44.665Z","load_balancing_strategy":"primary","db_duration_s":0.002101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 241.309866] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fd087345cf10f94ddb2ab338","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fd087345cf10f94ddb2ab338: start","job_status":"start","queue_duration_s":0.309591,"scheduling_latency_s":0.309608}1287gitlab # [ 241.323045] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fd087345cf10f94ddb2ab338","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fd087345cf10f94ddb2ab338: done: 0.048091 sec","job_status":"done","queue_duration_s":0.309591,"scheduling_latency_s":0.309608,"redis_calls":16,"redis_duration_s":0.0019190000000000001,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002346,"duration_s":0.048091,"completed_at":"2026-09-04T06:44:44.714Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 241.364909] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d5676cf4502522b8fa7d85e2","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d5676cf4502522b8fa7d85e2: start","job_status":"start","queue_duration_s":0.35897,"scheduling_latency_s":0.358986}1289gitlab # [ 241.377906] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d5676cf4502522b8fa7d85e2","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d5676cf4502522b8fa7d85e2: done: 0.016582 sec","job_status":"done","queue_duration_s":0.35897,"scheduling_latency_s":0.358986,"redis_calls":13,"redis_duration_s":0.0017490000000000001,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016582,"completed_at":"2026-09-04T06:44:44.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001771,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 241.417668] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bbe60088306f22ee9ff8b156","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bbe60088306f22ee9ff8b156: start","job_status":"start","queue_duration_s":0.376781,"scheduling_latency_s":0.376798}1291gitlab # [ 241.430454] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bbe60088306f22ee9ff8b156","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bbe60088306f22ee9ff8b156: done: 0.016155 sec","job_status":"done","queue_duration_s":0.376781,"scheduling_latency_s":0.376798,"redis_calls":13,"redis_duration_s":0.001644,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016155,"completed_at":"2026-09-04T06:44:44.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 241.468800] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"216aa78cfd0d97c054263d66","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-216aa78cfd0d97c054263d66: start","job_status":"start","queue_duration_s":0.394004,"scheduling_latency_s":0.394021}1293gitlab # [ 241.481715] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"216aa78cfd0d97c054263d66","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-216aa78cfd0d97c054263d66: done: 0.015968 sec","job_status":"done","queue_duration_s":0.394004,"scheduling_latency_s":0.394021,"redis_calls":13,"redis_duration_s":0.0016220000000000002,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015968,"completed_at":"2026-09-04T06:44:44.767Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 241.520446] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f70ccefd686184780387cbf5","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f70ccefd686184780387cbf5: start","job_status":"start","queue_duration_s":0.411033,"scheduling_latency_s":0.411049}1295gitlab # [ 241.533473] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f70ccefd686184780387cbf5","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f70ccefd686184780387cbf5: done: 0.016038 sec","job_status":"done","queue_duration_s":0.411033,"scheduling_latency_s":0.411049,"redis_calls":13,"redis_duration_s":0.0015010000000000002,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016038,"completed_at":"2026-09-04T06:44:44.784Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 241.573430] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"e8042a9b444fd13e4ec7cdeb","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-e8042a9b444fd13e4ec7cdeb: start","job_status":"start","queue_duration_s":0.428282,"scheduling_latency_s":0.428299}1297gitlab # [ 241.586382] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"e8042a9b444fd13e4ec7cdeb","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-e8042a9b444fd13e4ec7cdeb: done: 0.015847 sec","job_status":"done","queue_duration_s":0.428282,"scheduling_latency_s":0.428299,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015847,"completed_at":"2026-09-04T06:44:44.801Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001542,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 241.625418] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1f1148b832984e6d09ce3c05","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1f1148b832984e6d09ce3c05: start","job_status":"start","queue_duration_s":0.445153,"scheduling_latency_s":0.445169}1299gitlab # [ 241.639545] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1f1148b832984e6d09ce3c05","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1f1148b832984e6d09ce3c05: done: 0.021314 sec","job_status":"done","queue_duration_s":0.445153,"scheduling_latency_s":0.445169,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021314,"completed_at":"2026-09-04T06:44:44.823Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 241.678812] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3ee5c5019f1d4291d673135d","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3ee5c5019f1d4291d673135d: start","job_status":"start","queue_duration_s":0.467768,"scheduling_latency_s":0.467784}1301gitlab # [ 241.692049] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3ee5c5019f1d4291d673135d","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3ee5c5019f1d4291d673135d: done: 0.015435 sec","job_status":"done","queue_duration_s":0.467768,"scheduling_latency_s":0.467784,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015435,"completed_at":"2026-09-04T06:44:44.840Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 241.731240] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1702dc5b1a91684757f8c039","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1702dc5b1a91684757f8c039: start","job_status":"start","queue_duration_s":0.484629,"scheduling_latency_s":0.484646}1303gitlab # [ 241.745237] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1702dc5b1a91684757f8c039","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1702dc5b1a91684757f8c039: done: 0.015293 sec","job_status":"done","queue_duration_s":0.484629,"scheduling_latency_s":0.484646,"redis_calls":13,"redis_duration_s":0.001615,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015293,"completed_at":"2026-09-04T06:44:44.856Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 241.784485] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8b44db0139ba9937b13e24a7","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8b44db0139ba9937b13e24a7: start","job_status":"start","queue_duration_s":0.500965,"scheduling_latency_s":0.500981}1305gitlab # [ 241.798037] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8b44db0139ba9937b13e24a7","created_at":"2026-09-04T06:44:44.335Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-0070a3625d3c43dc","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"90c67983c2a920ba0c66dcc7a929213c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.357Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8b44db0139ba9937b13e24a7: done: 0.015184 sec","job_status":"done","queue_duration_s":0.500965,"scheduling_latency_s":0.500981,"redis_calls":13,"redis_duration_s":0.0014620000000000002,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015184,"completed_at":"2026-09-04T06:44:44.873Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 241.837216] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81c9f6b89cb84f1565acf329","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81c9f6b89cb84f1565acf329: start","job_status":"start","queue_duration_s":0.412479,"scheduling_latency_s":0.412495}1307gitlab # [ 241.849604] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81c9f6b89cb84f1565acf329","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81c9f6b89cb84f1565acf329: done: 0.02079 sec","job_status":"done","queue_duration_s":0.412479,"scheduling_latency_s":0.412495,"redis_calls":16,"redis_duration_s":0.002023,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001201,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022596,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02079,"completed_at":"2026-09-04T06:44:44.895Z","load_balancing_strategy":"primary","db_duration_s":0.000595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 241.890088] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80feadda71335f234f68e277","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80feadda71335f234f68e277: start","job_status":"start","queue_duration_s":0.434408,"scheduling_latency_s":0.434426}1309gitlab # [ 241.902440] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80feadda71335f234f68e277","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80feadda71335f234f68e277: done: 0.014636 sec","job_status":"done","queue_duration_s":0.434408,"scheduling_latency_s":0.434426,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014636,"completed_at":"2026-09-04T06:44:44.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 241.941102] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f170d40f0204c4767ecb9a4","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f170d40f0204c4767ecb9a4: start","job_status":"start","queue_duration_s":0.450091,"scheduling_latency_s":0.450107}1311gitlab # [ 241.954175] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f170d40f0204c4767ecb9a4","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f170d40f0204c4767ecb9a4: done: 0.014401 sec","job_status":"done","queue_duration_s":0.450091,"scheduling_latency_s":0.450107,"redis_calls":13,"redis_duration_s":0.001392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014401,"completed_at":"2026-09-04T06:44:44.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 241.993147] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0e4dd017038d5b3fc63a041","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0e4dd017038d5b3fc63a041: start","job_status":"start","queue_duration_s":0.465631,"scheduling_latency_s":0.465648}1313gitlab # [ 242.005201] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0e4dd017038d5b3fc63a041","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0e4dd017038d5b3fc63a041: done: 0.014844 sec","job_status":"done","queue_duration_s":0.465631,"scheduling_latency_s":0.465648,"redis_calls":13,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014844,"completed_at":"2026-09-04T06:44:44.942Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 242.043784] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99329b6180fa7bcd131d57bd","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99329b6180fa7bcd131d57bd: start","job_status":"start","queue_duration_s":0.481521,"scheduling_latency_s":0.481536}1315gitlab # [ 242.056130] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99329b6180fa7bcd131d57bd","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99329b6180fa7bcd131d57bd: done: 0.014412 sec","job_status":"done","queue_duration_s":0.481521,"scheduling_latency_s":0.481536,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014412,"completed_at":"2026-09-04T06:44:44.957Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 242.094302] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f429f2213e267d45f60ced6","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f429f2213e267d45f60ced6: start","job_status":"start","queue_duration_s":0.497146,"scheduling_latency_s":0.497162}1317gitlab # [ 242.106364] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f429f2213e267d45f60ced6","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f429f2213e267d45f60ced6: done: 0.01417 sec","job_status":"done","queue_duration_s":0.497146,"scheduling_latency_s":0.497162,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01417,"completed_at":"2026-09-04T06:44:44.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 242.144528] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"150bc8eaf72aeaf301f52f96","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-150bc8eaf72aeaf301f52f96: start","job_status":"start","queue_duration_s":0.512539,"scheduling_latency_s":0.512556}1319gitlab # [ 242.157893] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"150bc8eaf72aeaf301f52f96","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-150bc8eaf72aeaf301f52f96: done: 0.014513 sec","job_status":"done","queue_duration_s":0.512539,"scheduling_latency_s":0.512556,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014513,"completed_at":"2026-09-04T06:44:44.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 242.196452] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:44.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0532d5993b4208c90a0dd68","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0532d5993b4208c90a0dd68: start","job_status":"start","queue_duration_s":0.528305,"scheduling_latency_s":0.528322}1321gitlab # [ 242.208329] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0532d5993b4208c90a0dd68","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0532d5993b4208c90a0dd68: done: 0.014291 sec","job_status":"done","queue_duration_s":0.528305,"scheduling_latency_s":0.528322,"redis_calls":13,"redis_duration_s":0.001413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014291,"completed_at":"2026-09-04T06:44:45.004Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 242.246866] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17fd959bc8e222479eb32154","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17fd959bc8e222479eb32154: start","job_status":"start","queue_duration_s":0.543801,"scheduling_latency_s":0.543818}1323gitlab # [ 242.259176] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17fd959bc8e222479eb32154","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17fd959bc8e222479eb32154: done: 0.014358 sec","job_status":"done","queue_duration_s":0.543801,"scheduling_latency_s":0.543818,"redis_calls":13,"redis_duration_s":0.001386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014358,"completed_at":"2026-09-04T06:44:45.020Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 242.297726] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"755270f9286b7df8e9928206","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-755270f9286b7df8e9928206: start","job_status":"start","queue_duration_s":0.559374,"scheduling_latency_s":0.559391}1325gitlab # [ 242.309708] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"755270f9286b7df8e9928206","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-755270f9286b7df8e9928206: done: 0.014285 sec","job_status":"done","queue_duration_s":0.559374,"scheduling_latency_s":0.559391,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014285,"completed_at":"2026-09-04T06:44:45.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 242.348195] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5495b555d18140d0473ca725","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5495b555d18140d0473ca725: start","job_status":"start","queue_duration_s":0.574538,"scheduling_latency_s":0.574554}1327gitlab # [ 242.361189] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5495b555d18140d0473ca725","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5495b555d18140d0473ca725: done: 0.014512 sec","job_status":"done","queue_duration_s":0.574538,"scheduling_latency_s":0.574554,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014512,"completed_at":"2026-09-04T06:44:45.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 242.399561] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98746a6febce1e1ad652ca34","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98746a6febce1e1ad652ca34: start","job_status":"start","queue_duration_s":0.590102,"scheduling_latency_s":0.590118}1329gitlab # [ 242.412114] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98746a6febce1e1ad652ca34","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98746a6febce1e1ad652ca34: done: 0.014585 sec","job_status":"done","queue_duration_s":0.590102,"scheduling_latency_s":0.590118,"redis_calls":13,"redis_duration_s":0.001628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014585,"completed_at":"2026-09-04T06:44:45.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 242.450671] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4aa8910b6425f6d31b95ed5e","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4aa8910b6425f6d31b95ed5e: start","job_status":"start","queue_duration_s":0.605755,"scheduling_latency_s":0.605771}1331gitlab # [ 242.463023] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4aa8910b6425f6d31b95ed5e","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4aa8910b6425f6d31b95ed5e: done: 0.014195 sec","job_status":"done","queue_duration_s":0.605755,"scheduling_latency_s":0.605771,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014195,"completed_at":"2026-09-04T06:44:45.081Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 242.501587] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e977ed3833c51e68c688ddb","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e977ed3833c51e68c688ddb: start","job_status":"start","queue_duration_s":0.620987,"scheduling_latency_s":0.621003}1333gitlab # [ 242.513757] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e977ed3833c51e68c688ddb","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e977ed3833c51e68c688ddb: done: 0.014411 sec","job_status":"done","queue_duration_s":0.620987,"scheduling_latency_s":0.621003,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014411,"completed_at":"2026-09-04T06:44:45.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 242.552135] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"354ccfd2f36067d7615465bd","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-354ccfd2f36067d7615465bd: start","job_status":"start","queue_duration_s":0.636478,"scheduling_latency_s":0.636494}1335gitlab # [ 242.565252] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"354ccfd2f36067d7615465bd","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-354ccfd2f36067d7615465bd: done: 0.014413 sec","job_status":"done","queue_duration_s":0.636478,"scheduling_latency_s":0.636494,"redis_calls":13,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014413,"completed_at":"2026-09-04T06:44:45.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 242.603807] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cc6c546e4c870c6979d224c","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cc6c546e4c870c6979d224c: start","job_status":"start","queue_duration_s":0.652115,"scheduling_latency_s":0.652131}1337gitlab # [ 242.615988] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cc6c546e4c870c6979d224c","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cc6c546e4c870c6979d224c: done: 0.014342 sec","job_status":"done","queue_duration_s":0.652115,"scheduling_latency_s":0.652131,"redis_calls":13,"redis_duration_s":0.001386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014342,"completed_at":"2026-09-04T06:44:45.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 242.654177] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85b972383fad9aeff6adab12","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85b972383fad9aeff6adab12: start","job_status":"start","queue_duration_s":0.667641,"scheduling_latency_s":0.667657}1339gitlab # [ 242.666400] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85b972383fad9aeff6adab12","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85b972383fad9aeff6adab12: done: 0.014826 sec","job_status":"done","queue_duration_s":0.667641,"scheduling_latency_s":0.667657,"redis_calls":13,"redis_duration_s":0.0014559999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014826,"completed_at":"2026-09-04T06:44:45.144Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 242.704900] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7674cdda3c6f8b3823f425d7","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7674cdda3c6f8b3823f425d7: start","job_status":"start","queue_duration_s":0.683692,"scheduling_latency_s":0.683709}1341gitlab # [ 242.717470] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7674cdda3c6f8b3823f425d7","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7674cdda3c6f8b3823f425d7: done: 0.014447 sec","job_status":"done","queue_duration_s":0.683692,"scheduling_latency_s":0.683709,"redis_calls":13,"redis_duration_s":0.0014199999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014447,"completed_at":"2026-09-04T06:44:45.160Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 242.756534] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"626edfe974e76223332fd08b","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-626edfe974e76223332fd08b: start","job_status":"start","queue_duration_s":0.699366,"scheduling_latency_s":0.699382}1343gitlab # [ 242.769505] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"626edfe974e76223332fd08b","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-626edfe974e76223332fd08b: done: 0.015159 sec","job_status":"done","queue_duration_s":0.699366,"scheduling_latency_s":0.699382,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015159,"completed_at":"2026-09-04T06:44:45.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 242.807973] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da12dd5354bc72ce8cc760f0","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da12dd5354bc72ce8cc760f0: start","job_status":"start","queue_duration_s":0.71584,"scheduling_latency_s":0.715858}1345gitlab # [ 242.820209] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da12dd5354bc72ce8cc760f0","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da12dd5354bc72ce8cc760f0: done: 0.014936 sec","job_status":"done","queue_duration_s":0.71584,"scheduling_latency_s":0.715858,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014936,"completed_at":"2026-09-04T06:44:45.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 242.858876] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2a42a1ff04df59739e0e054","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2a42a1ff04df59739e0e054: start","job_status":"start","queue_duration_s":0.731837,"scheduling_latency_s":0.731853}1347gitlab # [ 242.871347] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2a42a1ff04df59739e0e054","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2a42a1ff04df59739e0e054: done: 0.014893 sec","job_status":"done","queue_duration_s":0.731837,"scheduling_latency_s":0.731853,"redis_calls":13,"redis_duration_s":0.0015990000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014893,"completed_at":"2026-09-04T06:44:45.208Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 242.909994] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db80e0aefc6ee45f9d655553","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db80e0aefc6ee45f9d655553: start","job_status":"start","queue_duration_s":0.747778,"scheduling_latency_s":0.747794}1349gitlab # [ 242.922203] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db80e0aefc6ee45f9d655553","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db80e0aefc6ee45f9d655553: done: 0.014591 sec","job_status":"done","queue_duration_s":0.747778,"scheduling_latency_s":0.747794,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014591,"completed_at":"2026-09-04T06:44:45.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 242.960277] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7efab673d1b1e629d6dc71b","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7efab673d1b1e629d6dc71b: start","job_status":"start","queue_duration_s":0.763428,"scheduling_latency_s":0.763444}1351gitlab # [ 242.973111] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7efab673d1b1e629d6dc71b","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7efab673d1b1e629d6dc71b: done: 0.014572 sec","job_status":"done","queue_duration_s":0.763428,"scheduling_latency_s":0.763444,"redis_calls":13,"redis_duration_s":0.0016320000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014572,"completed_at":"2026-09-04T06:44:45.239Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 243.011071] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa3b517c1cd547897fb18522","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa3b517c1cd547897fb18522: start","job_status":"start","queue_duration_s":0.779114,"scheduling_latency_s":0.77913}1353gitlab # [ 243.023224] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa3b517c1cd547897fb18522","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa3b517c1cd547897fb18522: done: 0.014834 sec","job_status":"done","queue_duration_s":0.779114,"scheduling_latency_s":0.77913,"redis_calls":13,"redis_duration_s":0.001396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014834,"completed_at":"2026-09-04T06:44:45.255Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 243.061005] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c76b58d3b02e1cad7e8f2a87","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c76b58d3b02e1cad7e8f2a87: start","job_status":"start","queue_duration_s":0.794995,"scheduling_latency_s":0.79501}1355gitlab # [ 243.072874] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c76b58d3b02e1cad7e8f2a87","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c76b58d3b02e1cad7e8f2a87: done: 0.014092 sec","job_status":"done","queue_duration_s":0.794995,"scheduling_latency_s":0.79501,"redis_calls":13,"redis_duration_s":0.0013809999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014092,"completed_at":"2026-09-04T06:44:45.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 243.110923] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"971cb2e49feda10aa3094e26","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-971cb2e49feda10aa3094e26: start","job_status":"start","queue_duration_s":0.810321,"scheduling_latency_s":0.810337}1357gitlab # [ 243.122963] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"971cb2e49feda10aa3094e26","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-971cb2e49feda10aa3094e26: done: 0.0144 sec","job_status":"done","queue_duration_s":0.810321,"scheduling_latency_s":0.810337,"redis_calls":13,"redis_duration_s":0.001466,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0144,"completed_at":"2026-09-04T06:44:45.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 243.160657] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b4e76099bc2646a4f2c5237","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b4e76099bc2646a4f2c5237: start","job_status":"start","queue_duration_s":0.826002,"scheduling_latency_s":0.826018}1359gitlab # [ 243.173575] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b4e76099bc2646a4f2c5237","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b4e76099bc2646a4f2c5237: done: 0.020327 sec","job_status":"done","queue_duration_s":0.826002,"scheduling_latency_s":0.826018,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020327,"completed_at":"2026-09-04T06:44:45.308Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 243.211579] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8919213f4860f38370da1e0","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8919213f4860f38370da1e0: start","job_status":"start","queue_duration_s":0.847409,"scheduling_latency_s":0.847426}1361gitlab # [ 243.223772] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8919213f4860f38370da1e0","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8919213f4860f38370da1e0: done: 0.014741 sec","job_status":"done","queue_duration_s":0.847409,"scheduling_latency_s":0.847426,"redis_calls":13,"redis_duration_s":0.0014750000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014741,"completed_at":"2026-09-04T06:44:45.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 243.262031] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52f0955bbf3e5be5f68d0bdb","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52f0955bbf3e5be5f68d0bdb: start","job_status":"start","queue_duration_s":0.863481,"scheduling_latency_s":0.863497}1363gitlab # [ 243.274242] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52f0955bbf3e5be5f68d0bdb","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52f0955bbf3e5be5f68d0bdb: done: 0.014213 sec","job_status":"done","queue_duration_s":0.863481,"scheduling_latency_s":0.863497,"redis_calls":13,"redis_duration_s":0.00137,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014213,"completed_at":"2026-09-04T06:44:45.339Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 243.312126] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d865979711fb783fcab33bc","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d865979711fb783fcab33bc: start","job_status":"start","queue_duration_s":0.878891,"scheduling_latency_s":0.878908}1365gitlab # [ 243.324034] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d865979711fb783fcab33bc","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d865979711fb783fcab33bc: done: 0.01443 sec","job_status":"done","queue_duration_s":0.878891,"scheduling_latency_s":0.878908,"redis_calls":13,"redis_duration_s":0.0013779999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01443,"completed_at":"2026-09-04T06:44:45.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 243.361760] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2e95652728f5352215589b4","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2e95652728f5352215589b4: start","job_status":"start","queue_duration_s":0.894601,"scheduling_latency_s":0.894618}1367gitlab # [ 243.374799] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2e95652728f5352215589b4","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2e95652728f5352215589b4: done: 0.01469 sec","job_status":"done","queue_duration_s":0.894601,"scheduling_latency_s":0.894618,"redis_calls":13,"redis_duration_s":0.001827,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01469,"completed_at":"2026-09-04T06:44:45.371Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 243.412688] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c95d733848ece5da46f877e8","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c95d733848ece5da46f877e8: start","job_status":"start","queue_duration_s":0.910547,"scheduling_latency_s":0.910564}1369gitlab # [ 243.425154] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c95d733848ece5da46f877e8","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c95d733848ece5da46f877e8: done: 0.014112 sec","job_status":"done","queue_duration_s":0.910547,"scheduling_latency_s":0.910564,"redis_calls":13,"redis_duration_s":0.0015559999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014112,"completed_at":"2026-09-04T06:44:45.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 243.463484] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6453fd1e791eca76ad940c3","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6453fd1e791eca76ad940c3: start","job_status":"start","queue_duration_s":0.925931,"scheduling_latency_s":0.925949}1371gitlab # [ 243.475695] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6453fd1e791eca76ad940c3","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6453fd1e791eca76ad940c3: done: 0.014143 sec","job_status":"done","queue_duration_s":0.925931,"scheduling_latency_s":0.925949,"redis_calls":13,"redis_duration_s":0.001408,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014143,"completed_at":"2026-09-04T06:44:45.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 243.514162] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50879667521786c553eda25e","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50879667521786c553eda25e: start","job_status":"start","queue_duration_s":0.941147,"scheduling_latency_s":0.941164}1373gitlab # [ 243.526662] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50879667521786c553eda25e","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50879667521786c553eda25e: done: 0.089255 sec","job_status":"done","queue_duration_s":0.941147,"scheduling_latency_s":0.941164,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.089255,"completed_at":"2026-09-04T06:44:45.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 243.564585] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"decfc80ba2e130d96606026c","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-decfc80ba2e130d96606026c: start","job_status":"start","queue_duration_s":1.031498,"scheduling_latency_s":1.031514}1375gitlab # [ 243.577246] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"decfc80ba2e130d96606026c","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-decfc80ba2e130d96606026c: done: 0.014497 sec","job_status":"done","queue_duration_s":1.031498,"scheduling_latency_s":1.031514,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014497,"completed_at":"2026-09-04T06:44:45.507Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 243.615457] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0adca78b213131aa12dab254","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0adca78b213131aa12dab254: start","job_status":"start","queue_duration_s":1.047058,"scheduling_latency_s":1.047074}1377gitlab # [ 243.627689] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0adca78b213131aa12dab254","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0adca78b213131aa12dab254: done: 0.014049 sec","job_status":"done","queue_duration_s":1.047058,"scheduling_latency_s":1.047074,"redis_calls":13,"redis_duration_s":0.001346,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014049,"completed_at":"2026-09-04T06:44:45.523Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 243.665844] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6971a028192f60ef1aeaef01","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6971a028192f60ef1aeaef01: start","job_status":"start","queue_duration_s":1.062142,"scheduling_latency_s":1.062158}1379gitlab # [ 243.677893] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6971a028192f60ef1aeaef01","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6971a028192f60ef1aeaef01: done: 0.014372 sec","job_status":"done","queue_duration_s":1.062142,"scheduling_latency_s":1.062158,"redis_calls":13,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014372,"completed_at":"2026-09-04T06:44:45.538Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 243.715956] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acc73bc2a3619f0c799bc9e5","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acc73bc2a3619f0c799bc9e5: start","job_status":"start","queue_duration_s":1.077596,"scheduling_latency_s":1.077612}1381gitlab # [ 243.728257] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acc73bc2a3619f0c799bc9e5","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acc73bc2a3619f0c799bc9e5: done: 0.014385 sec","job_status":"done","queue_duration_s":1.077596,"scheduling_latency_s":1.077612,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014385,"completed_at":"2026-09-04T06:44:45.553Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 243.766489] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc92c3eae2888d3e28bdca46","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc92c3eae2888d3e28bdca46: start","job_status":"start","queue_duration_s":1.093081,"scheduling_latency_s":1.093097}1383gitlab # [ 243.778526] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc92c3eae2888d3e28bdca46","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc92c3eae2888d3e28bdca46: done: 0.014631 sec","job_status":"done","queue_duration_s":1.093081,"scheduling_latency_s":1.093097,"redis_calls":13,"redis_duration_s":0.001364,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014631,"completed_at":"2026-09-04T06:44:45.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 243.817356] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe4f769c9d64fb749acd1d3f","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe4f769c9d64fb749acd1d3f: start","job_status":"start","queue_duration_s":1.108875,"scheduling_latency_s":1.108891}1385gitlab # [ 243.829493] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe4f769c9d64fb749acd1d3f","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe4f769c9d64fb749acd1d3f: done: 0.014437 sec","job_status":"done","queue_duration_s":1.108875,"scheduling_latency_s":1.108891,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014437,"completed_at":"2026-09-04T06:44:45.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 243.867825] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d6a6e518c8e9ef348f50090","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d6a6e518c8e9ef348f50090: start","job_status":"start","queue_duration_s":1.124299,"scheduling_latency_s":1.124314}1387gitlab # [ 243.880153] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d6a6e518c8e9ef348f50090","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d6a6e518c8e9ef348f50090: done: 0.014294 sec","job_status":"done","queue_duration_s":1.124299,"scheduling_latency_s":1.124314,"redis_calls":13,"redis_duration_s":0.0013800000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014294,"completed_at":"2026-09-04T06:44:45.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 243.918546] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b0affb65d4c4bcd2109bbde","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b0affb65d4c4bcd2109bbde: start","job_status":"start","queue_duration_s":1.140146,"scheduling_latency_s":1.140162}1389gitlab # [ 243.930869] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b0affb65d4c4bcd2109bbde","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b0affb65d4c4bcd2109bbde: done: 0.014446 sec","job_status":"done","queue_duration_s":1.140146,"scheduling_latency_s":1.140162,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014446,"completed_at":"2026-09-04T06:44:45.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 243.969158] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0630cbea654ae3e606258e29","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0630cbea654ae3e606258e29: start","job_status":"start","queue_duration_s":1.155695,"scheduling_latency_s":1.15571}1391gitlab # [ 243.981179] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0630cbea654ae3e606258e29","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0630cbea654ae3e606258e29: done: 0.014353 sec","job_status":"done","queue_duration_s":1.155695,"scheduling_latency_s":1.15571,"redis_calls":13,"redis_duration_s":0.00141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014353,"completed_at":"2026-09-04T06:44:45.631Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 244.020249] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb790efe2451614e40ff6822","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb790efe2451614e40ff6822: start","job_status":"start","queue_duration_s":1.171114,"scheduling_latency_s":1.17113}1393gitlab # [ 244.032661] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb790efe2451614e40ff6822","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb790efe2451614e40ff6822: done: 0.01441 sec","job_status":"done","queue_duration_s":1.171114,"scheduling_latency_s":1.17113,"redis_calls":13,"redis_duration_s":0.001376,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01441,"completed_at":"2026-09-04T06:44:45.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 244.070943] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77c558c854e10b662d3ed9b1","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77c558c854e10b662d3ed9b1: start","job_status":"start","queue_duration_s":1.186701,"scheduling_latency_s":1.186717}1395gitlab # [ 244.083223] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77c558c854e10b662d3ed9b1","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77c558c854e10b662d3ed9b1: done: 0.014114 sec","job_status":"done","queue_duration_s":1.186701,"scheduling_latency_s":1.186717,"redis_calls":13,"redis_duration_s":0.00138,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014114,"completed_at":"2026-09-04T06:44:45.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 244.121491] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"796926a25fc0df59cf73f307","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-796926a25fc0df59cf73f307: start","job_status":"start","queue_duration_s":1.202575,"scheduling_latency_s":1.202592}1397gitlab # [ 244.133519] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"796926a25fc0df59cf73f307","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-796926a25fc0df59cf73f307: done: 0.014187 sec","job_status":"done","queue_duration_s":1.202575,"scheduling_latency_s":1.202592,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014187,"completed_at":"2026-09-04T06:44:45.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 244.171876] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9debc4f3028ecf1542bedab","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9debc4f3028ecf1542bedab: start","job_status":"start","queue_duration_s":1.217831,"scheduling_latency_s":1.217858}1399gitlab # [ 244.184146] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9debc4f3028ecf1542bedab","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9debc4f3028ecf1542bedab: done: 0.014418 sec","job_status":"done","queue_duration_s":1.217831,"scheduling_latency_s":1.217858,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014418,"completed_at":"2026-09-04T06:44:45.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 244.224186] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4913aaf0df598f76607966dd","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4913aaf0df598f76607966dd: start","job_status":"start","queue_duration_s":1.233322,"scheduling_latency_s":1.233338}1401gitlab # [ 244.236328] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4913aaf0df598f76607966dd","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4913aaf0df598f76607966dd: done: 0.01434 sec","job_status":"done","queue_duration_s":1.233322,"scheduling_latency_s":1.233338,"redis_calls":13,"redis_duration_s":0.0014919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01434,"completed_at":"2026-09-04T06:44:45.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 244.275510] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0014c4d24101edba610b596f","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0014c4d24101edba610b596f: start","job_status":"start","queue_duration_s":1.248707,"scheduling_latency_s":1.248723}1403gitlab # [ 244.288131] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0014c4d24101edba610b596f","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0014c4d24101edba610b596f: done: 0.015149 sec","job_status":"done","queue_duration_s":1.248707,"scheduling_latency_s":1.248723,"redis_calls":13,"redis_duration_s":0.001358,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015149,"completed_at":"2026-09-04T06:44:45.725Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 244.326874] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69a5c38bf9b0321453b04b0e","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69a5c38bf9b0321453b04b0e: start","job_status":"start","queue_duration_s":1.264882,"scheduling_latency_s":1.264897}1405gitlab # [ 244.339402] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:44:45.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69a5c38bf9b0321453b04b0e","created_at":"2026-09-04T06:44:44.384Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-5029a315daf34e47","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceb5ebbcbff46e8b8cc3ceef1a119ed7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:44:44.461Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69a5c38bf9b0321453b04b0e: done: 0.01464 sec","job_status":"done","queue_duration_s":1.264882,"scheduling_latency_s":1.264897,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01464,"completed_at":"2026-09-04T06:44:45.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 263.474635] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:07.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"0c185bcedc5e008c6dbe7ce9","created_at":"2026-09-04T06:45:07.297Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2adcaa88170559fa76f7cbc2677ffba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.312Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-0c185bcedc5e008c6dbe7ce9: start","job_status":"start","queue_duration_s":0.003201,"scheduling_latency_s":0.003261}1407gitlab # [ 263.563536] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:07.405Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1408gitlab # [ 263.599568] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:07.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"0c185bcedc5e008c6dbe7ce9","created_at":"2026-09-04T06:45:07.297Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2adcaa88170559fa76f7cbc2677ffba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.312Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-0c185bcedc5e008c6dbe7ce9: done: 0.126422 sec","job_status":"done","queue_duration_s":0.003201,"scheduling_latency_s":0.003261,"redis_calls":7,"redis_duration_s":0.008511999999999999,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004859,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003653,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.126422,"completed_at":"2026-09-04T06:45:07.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 263.680831] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:07.443Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"6d42a900e9f70797507c6ca3","created_at":"2026-09-04T06:45:07.322Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85cc070233a14f0f19b345ec168ac651","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.333Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-6d42a900e9f70797507c6ca3: start","job_status":"start","queue_duration_s":0.109302,"scheduling_latency_s":0.109326}1410gitlab # [ 263.696184] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:07.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"6d42a900e9f70797507c6ca3","created_at":"2026-09-04T06:45:07.322Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85cc070233a14f0f19b345ec168ac651","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.333Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-6d42a900e9f70797507c6ca3: done: 0.077305 sec","job_status":"done","queue_duration_s":0.109302,"scheduling_latency_s":0.109326,"redis_calls":10,"redis_duration_s":0.004113,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000322,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000536,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068546,"duration_s":0.077305,"completed_at":"2026-09-04T06:45:07.520Z","load_balancing_strategy":"primary","db_duration_s":0.025291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 263.737238] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:07.525Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"5512e1999188cc9877c9c293","created_at":"2026-09-04T06:45:07.350Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f972fb15f9eebdfa9c2a518c80f11171","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.359Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-5512e1999188cc9877c9c293: start","job_status":"start","queue_duration_s":0.16597,"scheduling_latency_s":0.166017}1412gitlab # [ 263.869100] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:07.710Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"5512e1999188cc9877c9c293","created_at":"2026-09-04T06:45:07.350Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f972fb15f9eebdfa9c2a518c80f11171","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.359Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-5512e1999188cc9877c9c293: done: 0.185026 sec","job_status":"done","queue_duration_s":0.16597,"scheduling_latency_s":0.166017,"redis_calls":10,"redis_duration_s":0.0056300000000000005,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000658,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00152,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00134292,"duration_s":0.185026,"completed_at":"2026-09-04T06:45:07.710Z","load_balancing_strategy":"primary","db_duration_s":0.033789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 263.955752] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:07.715Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"63ba7ba49a0285963c7f594c","created_at":"2026-09-04T06:45:07.367Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce6a22820a0b1e1df675d55b7567eb5e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.371Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-63ba7ba49a0285963c7f594c: start","job_status":"start","queue_duration_s":0.343388,"scheduling_latency_s":0.343414}1414gitlab # [ 264.071336] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:07.912Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"63ba7ba49a0285963c7f594c","created_at":"2026-09-04T06:45:07.367Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce6a22820a0b1e1df675d55b7567eb5e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.371Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-63ba7ba49a0285963c7f594c: done: 0.197558 sec","job_status":"done","queue_duration_s":0.343388,"scheduling_latency_s":0.343414,"redis_calls":7,"redis_duration_s":0.023455999999999998,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005508,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.197558,"completed_at":"2026-09-04T06:45:07.912Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 264.154118] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:07.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b0e965e2ae27d04668495338","created_at":"2026-09-04T06:45:07.387Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51845da2e89e93a22abefab833a8664c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.399Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b0e965e2ae27d04668495338: start","job_status":"start","queue_duration_s":0.563693,"scheduling_latency_s":0.563727}1416gitlab # [ 264.170843] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:07.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b0e965e2ae27d04668495338","created_at":"2026-09-04T06:45:07.387Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51845da2e89e93a22abefab833a8664c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.399Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b0e965e2ae27d04668495338: done: 0.035642 sec","job_status":"done","queue_duration_s":0.563693,"scheduling_latency_s":0.563727,"redis_calls":7,"redis_duration_s":0.001629,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035642,"completed_at":"2026-09-04T06:45:07.999Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 264.218970] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.000Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"fe7b24d0ecb68b43c61fa8db","created_at":"2026-09-04T06:45:07.414Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbad108cc825b8fe3d5768a1ffd84654","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.425Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-fe7b24d0ecb68b43c61fa8db: start","job_status":"start","queue_duration_s":0.575127,"scheduling_latency_s":0.57515}1418gitlab # [ 264.235151] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"fe7b24d0ecb68b43c61fa8db","created_at":"2026-09-04T06:45:07.414Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbad108cc825b8fe3d5768a1ffd84654","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.425Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-fe7b24d0ecb68b43c61fa8db: done: 0.024592 sec","job_status":"done","queue_duration_s":0.575127,"scheduling_latency_s":0.57515,"redis_calls":11,"redis_duration_s":0.001929,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00034,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000278,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000362,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033964,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.024592,"completed_at":"2026-09-04T06:45:08.025Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 264.278529] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b27cbfd12d2fbcd098eedebc","created_at":"2026-09-04T06:45:07.429Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca2523afd25ffc261333ba6d32e9901d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.435Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b27cbfd12d2fbcd098eedebc: start","job_status":"start","queue_duration_s":0.591524,"scheduling_latency_s":0.591549}1420gitlab # [ 264.292502] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b27cbfd12d2fbcd098eedebc","created_at":"2026-09-04T06:45:07.429Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca2523afd25ffc261333ba6d32e9901d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.435Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b27cbfd12d2fbcd098eedebc: done: 0.045129 sec","job_status":"done","queue_duration_s":0.591524,"scheduling_latency_s":0.591549,"redis_calls":9,"redis_duration_s":0.001547,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055656,"exclusive_lock_hold_duration_s":0.02814406,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.045129,"completed_at":"2026-09-04T06:45:08.071Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 264.334275] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.073Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2f57cef34b5c6779bc0c1abd","created_at":"2026-09-04T06:45:07.440Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79cd61c8c8f997600ce2578fb8dc8d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T06:45:07.446Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2f57cef34b5c6779bc0c1abd: start","job_status":"start","queue_duration_s":0.626783,"scheduling_latency_s":0.626802}1422gitlab # [ 264.347492] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.081Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1423gitlab # [ 264.350926] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.087Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2f57cef34b5c6779bc0c1abd","created_at":"2026-09-04T06:45:07.440Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79cd61c8c8f997600ce2578fb8dc8d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T06:45:07.446Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2f57cef34b5c6779bc0c1abd: done: 0.013832 sec","job_status":"done","queue_duration_s":0.626783,"scheduling_latency_s":0.626802,"redis_calls":7,"redis_duration_s":0.001057,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013832,"completed_at":"2026-09-04T06:45:08.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 264.389349] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.088Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7f2a260231ef20c05a3b29fc","created_at":"2026-09-04T06:45:07.456Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d3e40a3973d9dc080693564691effe7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.467Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7f2a260231ef20c05a3b29fc: start","job_status":"start","queue_duration_s":0.620319,"scheduling_latency_s":0.620336}1425gitlab # [ 264.404300] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.096Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1426gitlab # [ 264.407358] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7f2a260231ef20c05a3b29fc","created_at":"2026-09-04T06:45:07.456Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d3e40a3973d9dc080693564691effe7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.467Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7f2a260231ef20c05a3b29fc: done: 0.012999 sec","job_status":"done","queue_duration_s":0.620319,"scheduling_latency_s":0.620336,"redis_calls":7,"redis_duration_s":0.001194,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012999,"completed_at":"2026-09-04T06:45:08.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 264.446790] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.102Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1d7d2b91c412d75cd6e688fb","created_at":"2026-09-04T06:45:07.470Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf22fb0d008cb17bca614fdd8de55740","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.476Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1d7d2b91c412d75cd6e688fb: start","job_status":"start","queue_duration_s":0.625452,"scheduling_latency_s":0.625467}1428gitlab # [ 264.460795] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.118Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1d7d2b91c412d75cd6e688fb","created_at":"2026-09-04T06:45:07.470Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf22fb0d008cb17bca614fdd8de55740","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.476Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1d7d2b91c412d75cd6e688fb: done: 0.015949 sec","job_status":"done","queue_duration_s":0.625452,"scheduling_latency_s":0.625467,"redis_calls":9,"redis_duration_s":0.001343,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00064,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045068,"exclusive_lock_hold_duration_s":0.00294184,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.015949,"completed_at":"2026-09-04T06:45:08.118Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001118,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 264.501411] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"91dbebbc1bd28068b6c76ba6","created_at":"2026-09-04T06:45:07.488Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f132de5a8b5164100254e712c0aadf05","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.490Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-91dbebbc1bd28068b6c76ba6: start","job_status":"start","queue_duration_s":0.628712,"scheduling_latency_s":0.628728}1430gitlab # [ 264.600979] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.443Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"91dbebbc1bd28068b6c76ba6","created_at":"2026-09-04T06:45:07.488Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f132de5a8b5164100254e712c0aadf05","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.490Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-91dbebbc1bd28068b6c76ba6: done: 0.323755 sec","job_status":"done","queue_duration_s":0.628712,"scheduling_latency_s":0.628728,"redis_calls":9,"redis_duration_s":0.001359,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00065,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.042,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.27168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0004555,"exclusive_lock_hold_duration_s":0.30956006,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.323755,"completed_at":"2026-09-04T06:45:08.443Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.068047,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 264.677082] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"af20619aea7232cb569234a2","created_at":"2026-09-04T06:45:07.499Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08f8fc5ecb040f473b0ca3da8dddb517","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T06:45:07.503Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-af20619aea7232cb569234a2: start","job_status":"start","queue_duration_s":0.94166,"scheduling_latency_s":0.94168}1432gitlab # [ 264.694142] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.452Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1433gitlab # [ 264.698562] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"af20619aea7232cb569234a2","created_at":"2026-09-04T06:45:07.499Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08f8fc5ecb040f473b0ca3da8dddb517","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T06:45:07.503Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-af20619aea7232cb569234a2: done: 0.013581 sec","job_status":"done","queue_duration_s":0.94166,"scheduling_latency_s":0.94168,"redis_calls":7,"redis_duration_s":0.0009630000000000001,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013581,"completed_at":"2026-09-04T06:45:08.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 264.738883] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9d16060036898cdf4f528e3f","created_at":"2026-09-04T06:45:07.529Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44bc9dd21268a0a0139d6fa3b53a0ab4","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.532Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9d16060036898cdf4f528e3f: start","job_status":"start","queue_duration_s":0.927534,"scheduling_latency_s":0.927555}1435gitlab # [ 264.995842] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9d16060036898cdf4f528e3f","created_at":"2026-09-04T06:45:07.529Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44bc9dd21268a0a0139d6fa3b53a0ab4","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.532Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9d16060036898cdf4f528e3f: done: 0.378358 sec","job_status":"done","queue_duration_s":0.927534,"scheduling_latency_s":0.927555,"redis_calls":562,"redis_duration_s":0.062032000000000004,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.061085,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.348982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.378358,"completed_at":"2026-09-04T06:45:08.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 265.089446] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.839Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"d39a31a778802e8118b792a4","created_at":"2026-09-04T06:45:07.567Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a1ac8e7709668ab3f93668a452b81e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.583Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-d39a31a778802e8118b792a4: start","job_status":"start","queue_duration_s":1.25613,"scheduling_latency_s":1.25615}1437gitlab # [ 265.108091] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.847Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1438gitlab # [ 265.111897] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"d39a31a778802e8118b792a4","created_at":"2026-09-04T06:45:07.567Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a1ac8e7709668ab3f93668a452b81e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.583Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-d39a31a778802e8118b792a4: done: 0.012992 sec","job_status":"done","queue_duration_s":1.25613,"scheduling_latency_s":1.25615,"redis_calls":7,"redis_duration_s":0.001588,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001144,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012992,"completed_at":"2026-09-04T06:45:08.852Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 265.153153] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"18ac452dcb471449322485df","created_at":"2026-09-04T06:45:07.604Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3be2e2512466ad964c16d5241118f624","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.609Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-18ac452dcb471449322485df: start","job_status":"start","queue_duration_s":1.245118,"scheduling_latency_s":1.245135}1440gitlab # [ 265.166085] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"18ac452dcb471449322485df","created_at":"2026-09-04T06:45:07.604Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3be2e2512466ad964c16d5241118f624","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.609Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-18ac452dcb471449322485df: done: 0.019963 sec","job_status":"done","queue_duration_s":1.245118,"scheduling_latency_s":1.245135,"redis_calls":9,"redis_duration_s":0.0023740000000000002,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00118,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00057956,"exclusive_lock_hold_duration_s":0.0050686,"duration_s":0.019963,"completed_at":"2026-09-04T06:45:08.874Z","load_balancing_strategy":"primary","db_duration_s":0.00266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 265.204993] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.876Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a5d1828a53af36c7204b1a1b","created_at":"2026-09-04T06:45:07.702Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b3f8cdfc04accd2d504ed2e2c42231d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.706Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a5d1828a53af36c7204b1a1b: start","job_status":"start","queue_duration_s":1.16973,"scheduling_latency_s":1.169746}1442gitlab # [ 265.220277] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a5d1828a53af36c7204b1a1b","created_at":"2026-09-04T06:45:07.702Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b3f8cdfc04accd2d504ed2e2c42231d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.706Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a5d1828a53af36c7204b1a1b: done: 0.014298 sec","job_status":"done","queue_duration_s":1.16973,"scheduling_latency_s":1.169746,"redis_calls":7,"redis_duration_s":0.001643,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014298,"completed_at":"2026-09-04T06:45:08.890Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 265.260022] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.892Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c7cca8df0524fde49b015042","created_at":"2026-09-04T06:45:07.717Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2544479e69ba4cd6cf71e08d34d062b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.723Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c7cca8df0524fde49b015042: start","job_status":"start","queue_duration_s":1.16863,"scheduling_latency_s":1.168647}1444gitlab # [ 265.272838] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c7cca8df0524fde49b015042","created_at":"2026-09-04T06:45:07.717Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2544479e69ba4cd6cf71e08d34d062b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.723Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c7cca8df0524fde49b015042: done: 0.029853 sec","job_status":"done","queue_duration_s":1.16863,"scheduling_latency_s":1.168647,"redis_calls":14,"redis_duration_s":0.003857,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.00035,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002686,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000821,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029853,"completed_at":"2026-09-04T06:45:08.921Z","load_balancing_strategy":"primary","db_duration_s":0.002362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 265.312671] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.923Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9dc00fbb953cd5625f254eaf","created_at":"2026-09-04T06:45:07.730Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d12e1174712e2633f5dbd8fd1fe1dd66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.736Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9dc00fbb953cd5625f254eaf: start","job_status":"start","queue_duration_s":1.186932,"scheduling_latency_s":1.186948}1446gitlab # [ 265.326853] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.986Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9dc00fbb953cd5625f254eaf","created_at":"2026-09-04T06:45:07.730Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d12e1174712e2633f5dbd8fd1fe1dd66","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.736Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9dc00fbb953cd5625f254eaf: done: 0.062775 sec","job_status":"done","queue_duration_s":1.186932,"scheduling_latency_s":1.186948,"redis_calls":9,"redis_duration_s":0.002826,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001394,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00080504,"exclusive_lock_hold_duration_s":0.0257964,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.062775,"completed_at":"2026-09-04T06:45:08.986Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 265.368837] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:08.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"516d2c5e5767432a7f0cb38b","created_at":"2026-09-04T06:45:07.751Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1725694486c1deb5ccc49f5d89833f77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.757Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-516d2c5e5767432a7f0cb38b: start","job_status":"start","queue_duration_s":1.230858,"scheduling_latency_s":1.230878}1448gitlab # [ 265.382900] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.005Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"516d2c5e5767432a7f0cb38b","created_at":"2026-09-04T06:45:07.751Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1725694486c1deb5ccc49f5d89833f77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.757Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-516d2c5e5767432a7f0cb38b: done: 0.016944 sec","job_status":"done","queue_duration_s":1.230858,"scheduling_latency_s":1.230878,"redis_calls":7,"redis_duration_s":0.002264,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016944,"completed_at":"2026-09-04T06:45:09.004Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 265.423222] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"884660a1e5a0c3422e24bc80","created_at":"2026-09-04T06:45:07.767Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da66f4a0f0b91276f7c35d5e7865c348","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.771Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-884660a1e5a0c3422e24bc80: start","job_status":"start","queue_duration_s":1.234898,"scheduling_latency_s":1.234915}1450gitlab # [ 265.437221] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.015Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1451gitlab # [ 265.440630] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.021Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"884660a1e5a0c3422e24bc80","created_at":"2026-09-04T06:45:07.767Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da66f4a0f0b91276f7c35d5e7865c348","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.771Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-884660a1e5a0c3422e24bc80: done: 0.015039 sec","job_status":"done","queue_duration_s":1.234898,"scheduling_latency_s":1.234915,"redis_calls":7,"redis_duration_s":0.001821,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000536,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015039,"completed_at":"2026-09-04T06:45:09.021Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 265.480040] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.023Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0370d09bf4775a2f90ca9a6e","created_at":"2026-09-04T06:45:07.786Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1bf4e763827f4e6b22889348f4987ca","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.790Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0370d09bf4775a2f90ca9a6e: start","job_status":"start","queue_duration_s":1.233061,"scheduling_latency_s":1.233077}1453gitlab # [ 265.493605] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.055Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0370d09bf4775a2f90ca9a6e","created_at":"2026-09-04T06:45:07.786Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1bf4e763827f4e6b22889348f4987ca","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.790Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0370d09bf4775a2f90ca9a6e: done: 0.03223 sec","job_status":"done","queue_duration_s":1.233061,"scheduling_latency_s":1.233077,"redis_calls":7,"redis_duration_s":0.002031,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001478,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000553,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.03223,"completed_at":"2026-09-04T06:45:09.055Z","load_balancing_strategy":"primary","db_duration_s":0.015873,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 265.533880] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.057Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"060ff3a38a1d5a6c89a55699","created_at":"2026-09-04T06:45:07.811Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.816Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-060ff3a38a1d5a6c89a55699: start","job_status":"start","queue_duration_s":1.240243,"scheduling_latency_s":1.240263}1455gitlab # [ 265.547029] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"060ff3a38a1d5a6c89a55699","created_at":"2026-09-04T06:45:07.811Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.816Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-060ff3a38a1d5a6c89a55699: done: 0.144686 sec","job_status":"done","queue_duration_s":1.240243,"scheduling_latency_s":1.240263,"redis_calls":60,"redis_duration_s":0.017686,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.000765,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.016226,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000695,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.130891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.144686,"completed_at":"2026-09-04T06:45:09.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 265.586928] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"eae295b8af04eca855a24e1d","created_at":"2026-09-04T06:45:07.839Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c1d3760f740fb912e3df3d9e550c2d2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.859Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-eae295b8af04eca855a24e1d: start","job_status":"start","queue_duration_s":1.344838,"scheduling_latency_s":1.344859}1457gitlab # [ 265.600246] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"eae295b8af04eca855a24e1d","created_at":"2026-09-04T06:45:07.839Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c1d3760f740fb912e3df3d9e550c2d2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.859Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-eae295b8af04eca855a24e1d: done: 0.046915 sec","job_status":"done","queue_duration_s":1.344838,"scheduling_latency_s":1.344859,"redis_calls":11,"redis_duration_s":0.002816,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000322,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00174,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000754,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009147,"duration_s":0.046915,"completed_at":"2026-09-04T06:45:09.251Z","load_balancing_strategy":"primary","db_duration_s":0.005604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 265.641065] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.255Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4bb8845e9a4145e87253005b","created_at":"2026-09-04T06:45:07.866Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59c22a67a0ebd5390c3d9f4f02f07751","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T06:45:07.874Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4bb8845e9a4145e87253005b: start","job_status":"start","queue_duration_s":1.380935,"scheduling_latency_s":1.380974}1459gitlab # [ 265.653699] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.300Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4bb8845e9a4145e87253005b","created_at":"2026-09-04T06:45:07.866Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59c22a67a0ebd5390c3d9f4f02f07751","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T06:45:07.874Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4bb8845e9a4145e87253005b: done: 0.045593 sec","job_status":"done","queue_duration_s":1.380935,"scheduling_latency_s":1.380974,"redis_calls":7,"redis_duration_s":0.002813,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002013,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0008,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045593,"completed_at":"2026-09-04T06:45:09.300Z","load_balancing_strategy":"primary","db_duration_s":0.003219,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 265.692370] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.305Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ff6dacfb7a6a7a7a6ec8824b","created_at":"2026-09-04T06:45:07.906Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"557a6e713a78120f1c966ae18fd559bb","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.927Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ff6dacfb7a6a7a7a6ec8824b: start","job_status":"start","queue_duration_s":1.377925,"scheduling_latency_s":1.37796}1461gitlab # [ 265.706369] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.345Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ff6dacfb7a6a7a7a6ec8824b","created_at":"2026-09-04T06:45:07.906Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"557a6e713a78120f1c966ae18fd559bb","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.927Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ff6dacfb7a6a7a7a6ec8824b: done: 0.040487 sec","job_status":"done","queue_duration_s":1.377925,"scheduling_latency_s":1.37796,"redis_calls":10,"redis_duration_s":0.003927,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002387,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00154,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00898048,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.040487,"completed_at":"2026-09-04T06:45:09.345Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004311,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1462gitlab # [ 265.747636] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.348Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"940b49621cf751f8b22852b7","created_at":"2026-09-04T06:45:07.962Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e96743e2e063434e79dc20ed988fd521","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.983Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-940b49621cf751f8b22852b7: start","job_status":"start","queue_duration_s":1.364761,"scheduling_latency_s":1.36479}1463gitlab # [ 265.761860] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"940b49621cf751f8b22852b7","created_at":"2026-09-04T06:45:07.962Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-7eb687501b3c4be7","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e96743e2e063434e79dc20ed988fd521","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-04T06:45:07.983Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-940b49621cf751f8b22852b7: done: 0.0312 sec","job_status":"done","queue_duration_s":1.364761,"scheduling_latency_s":1.36479,"redis_calls":11,"redis_duration_s":0.00324,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000602,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001725,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047122,"duration_s":0.0312,"completed_at":"2026-09-04T06:45:09.379Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 265.802947] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.381Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f786305731fd191a615ed8e","created_at":"2026-09-04T06:45:08.905Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-fbf5418afa804c7e","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2544479e69ba4cd6cf71e08d34d062b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:08.916Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f786305731fd191a615ed8e: start","job_status":"start","queue_duration_s":0.464561,"scheduling_latency_s":0.464584}1465gitlab # [ 265.815059] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.397Z","message":"No existing merge request to be cleaned up."}1466gitlab # [ 265.816721] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.409Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f786305731fd191a615ed8e","created_at":"2026-09-04T06:45:08.905Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-fbf5418afa804c7e","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2544479e69ba4cd6cf71e08d34d062b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:08.916Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f786305731fd191a615ed8e: done: 0.028294 sec","job_status":"done","queue_duration_s":0.464561,"scheduling_latency_s":0.464584,"redis_calls":10,"redis_duration_s":0.003362,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028294,"completed_at":"2026-09-04T06:45:09.409Z","load_balancing_strategy":"primary","db_duration_s":0.003121,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 265.855244] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.410Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ef37969215f9a13085d6fd89","created_at":"2026-09-04T06:45:08.905Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-fbf5418afa804c7e","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2544479e69ba4cd6cf71e08d34d062b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:08.916Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ef37969215f9a13085d6fd89: start","job_status":"start","queue_duration_s":0.494501,"scheduling_latency_s":0.494523}1468gitlab # [ 265.867283] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.425Z","message":"No existing merge request to be cleaned up."}1469gitlab # [ 265.868935] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.436Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ef37969215f9a13085d6fd89","created_at":"2026-09-04T06:45:08.905Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-fbf5418afa804c7e","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2544479e69ba4cd6cf71e08d34d062b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:08.916Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ef37969215f9a13085d6fd89: done: 0.025597 sec","job_status":"done","queue_duration_s":0.494501,"scheduling_latency_s":0.494523,"redis_calls":10,"redis_duration_s":0.002657,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001627,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025597,"completed_at":"2026-09-04T06:45:09.436Z","load_balancing_strategy":"primary","db_duration_s":0.002692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 265.906642] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.438Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bc17f7dcee5d295b5680697a","created_at":"2026-09-04T06:45:08.905Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-fbf5418afa804c7e","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2544479e69ba4cd6cf71e08d34d062b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:08.916Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bc17f7dcee5d295b5680697a: start","job_status":"start","queue_duration_s":0.521989,"scheduling_latency_s":0.522014}1471gitlab # [ 265.918579] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.452Z","message":"No existing merge request to be cleaned up."}1472gitlab # [ 265.920230] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.462Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bc17f7dcee5d295b5680697a","created_at":"2026-09-04T06:45:08.905Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-fbf5418afa804c7e","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2544479e69ba4cd6cf71e08d34d062b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:08.916Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bc17f7dcee5d295b5680697a: done: 0.023645 sec","job_status":"done","queue_duration_s":0.521989,"scheduling_latency_s":0.522014,"redis_calls":10,"redis_duration_s":0.002718,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001656,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023645,"completed_at":"2026-09-04T06:45:09.461Z","load_balancing_strategy":"primary","db_duration_s":0.002628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 265.958003] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.463Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aa9e13f037845c00a2077697","created_at":"2026-09-04T06:45:08.905Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-fbf5418afa804c7e","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2544479e69ba4cd6cf71e08d34d062b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:08.916Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aa9e13f037845c00a2077697: start","job_status":"start","queue_duration_s":0.547116,"scheduling_latency_s":0.547134}1474gitlab # [ 265.970426] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.475Z","message":"No existing merge request to be cleaned up."}1475gitlab # [ 265.972142] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.484Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aa9e13f037845c00a2077697","created_at":"2026-09-04T06:45:08.905Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-fbf5418afa804c7e","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e2544479e69ba4cd6cf71e08d34d062b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:08.916Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aa9e13f037845c00a2077697: done: 0.021061 sec","job_status":"done","queue_duration_s":0.547116,"scheduling_latency_s":0.547134,"redis_calls":10,"redis_duration_s":0.00253,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001498,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021061,"completed_at":"2026-09-04T06:45:09.484Z","load_balancing_strategy":"primary","db_duration_s":0.002445,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 266.010348] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30abe31c53ab4c714e664828","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30abe31c53ab4c714e664828: start","job_status":"start","queue_duration_s":0.293967,"scheduling_latency_s":0.293985}1477gitlab # [ 266.022846] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30abe31c53ab4c714e664828","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30abe31c53ab4c714e664828: done: 0.021894 sec","job_status":"done","queue_duration_s":0.293967,"scheduling_latency_s":0.293985,"redis_calls":13,"redis_duration_s":0.006559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003374,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021894,"completed_at":"2026-09-04T06:45:09.509Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 266.062660] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50c38b9ab4bc304304afb1f7","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50c38b9ab4bc304304afb1f7: start","job_status":"start","queue_duration_s":0.317223,"scheduling_latency_s":0.31724}1479gitlab # [ 266.075306] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50c38b9ab4bc304304afb1f7","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50c38b9ab4bc304304afb1f7: done: 0.015998 sec","job_status":"done","queue_duration_s":0.317223,"scheduling_latency_s":0.31724,"redis_calls":13,"redis_duration_s":0.00159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015998,"completed_at":"2026-09-04T06:45:09.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 266.114342] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d88dd494d37a0f0c299f9e0","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d88dd494d37a0f0c299f9e0: start","job_status":"start","queue_duration_s":0.334371,"scheduling_latency_s":0.334388}1481gitlab # [ 266.126844] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d88dd494d37a0f0c299f9e0","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d88dd494d37a0f0c299f9e0: done: 0.014884 sec","job_status":"done","queue_duration_s":0.334371,"scheduling_latency_s":0.334388,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014884,"completed_at":"2026-09-04T06:45:09.542Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 266.165799] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb1dd1009252bdd09bc1e166","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb1dd1009252bdd09bc1e166: start","job_status":"start","queue_duration_s":0.351983,"scheduling_latency_s":0.352}1483gitlab # [ 266.178217] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb1dd1009252bdd09bc1e166","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb1dd1009252bdd09bc1e166: done: 0.015379 sec","job_status":"done","queue_duration_s":0.351983,"scheduling_latency_s":0.352,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015379,"completed_at":"2026-09-04T06:45:09.560Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 266.217265] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de0e72bf572c8e74075939e7","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de0e72bf572c8e74075939e7: start","job_status":"start","queue_duration_s":0.368445,"scheduling_latency_s":0.368461}1485gitlab # [ 266.229325] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de0e72bf572c8e74075939e7","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de0e72bf572c8e74075939e7: done: 0.014634 sec","job_status":"done","queue_duration_s":0.368445,"scheduling_latency_s":0.368461,"redis_calls":13,"redis_duration_s":0.0014750000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014634,"completed_at":"2026-09-04T06:45:09.576Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 266.269252] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ea34ac26c715b34b935ce16","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ea34ac26c715b34b935ce16: start","job_status":"start","queue_duration_s":0.384136,"scheduling_latency_s":0.384152}1487gitlab # [ 266.281693] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ea34ac26c715b34b935ce16","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ea34ac26c715b34b935ce16: done: 0.014863 sec","job_status":"done","queue_duration_s":0.384136,"scheduling_latency_s":0.384152,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014863,"completed_at":"2026-09-04T06:45:09.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 266.320462] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"137a26b3a2322125c2d8f07b","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-137a26b3a2322125c2d8f07b: start","job_status":"start","queue_duration_s":0.40011,"scheduling_latency_s":0.400126}1489gitlab # [ 266.332829] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"137a26b3a2322125c2d8f07b","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-137a26b3a2322125c2d8f07b: done: 0.01526 sec","job_status":"done","queue_duration_s":0.40011,"scheduling_latency_s":0.400126,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01526,"completed_at":"2026-09-04T06:45:09.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 266.371820] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abb2bad1fa28fde174a925e4","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abb2bad1fa28fde174a925e4: start","job_status":"start","queue_duration_s":0.416419,"scheduling_latency_s":0.416435}1491gitlab # [ 266.384214] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abb2bad1fa28fde174a925e4","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abb2bad1fa28fde174a925e4: done: 0.014461 sec","job_status":"done","queue_duration_s":0.416419,"scheduling_latency_s":0.416435,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014461,"completed_at":"2026-09-04T06:45:09.624Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 266.422382] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af7bbabc4fd5319c57879cf3","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af7bbabc4fd5319c57879cf3: start","job_status":"start","queue_duration_s":0.431921,"scheduling_latency_s":0.431937}1493gitlab # [ 266.434700] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af7bbabc4fd5319c57879cf3","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af7bbabc4fd5319c57879cf3: done: 0.014759 sec","job_status":"done","queue_duration_s":0.431921,"scheduling_latency_s":0.431937,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014759,"completed_at":"2026-09-04T06:45:09.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 266.474072] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"128ebf473c44f84c8d52d3e9","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-128ebf473c44f84c8d52d3e9: start","job_status":"start","queue_duration_s":0.44777,"scheduling_latency_s":0.447787}1495gitlab # [ 266.486136] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"128ebf473c44f84c8d52d3e9","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-128ebf473c44f84c8d52d3e9: done: 0.014619 sec","job_status":"done","queue_duration_s":0.44777,"scheduling_latency_s":0.447787,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014619,"completed_at":"2026-09-04T06:45:09.655Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 266.524305] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9c82f9b20f1ceb12a308981","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9c82f9b20f1ceb12a308981: start","job_status":"start","queue_duration_s":0.465247,"scheduling_latency_s":0.465268}1497gitlab # [ 266.536654] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9c82f9b20f1ceb12a308981","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9c82f9b20f1ceb12a308981: done: 0.014846 sec","job_status":"done","queue_duration_s":0.465247,"scheduling_latency_s":0.465268,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014846,"completed_at":"2026-09-04T06:45:09.673Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 266.575074] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70afc21fa4656672492aeb90","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70afc21fa4656672492aeb90: start","job_status":"start","queue_duration_s":0.481208,"scheduling_latency_s":0.481224}1499gitlab # [ 266.587452] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70afc21fa4656672492aeb90","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70afc21fa4656672492aeb90: done: 0.014763 sec","job_status":"done","queue_duration_s":0.481208,"scheduling_latency_s":0.481224,"redis_calls":13,"redis_duration_s":0.001456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014763,"completed_at":"2026-09-04T06:45:09.689Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 266.625970] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e49c74cbe0ee8f97a164463a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e49c74cbe0ee8f97a164463a: start","job_status":"start","queue_duration_s":0.497042,"scheduling_latency_s":0.497059}1501gitlab # [ 266.638098] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e49c74cbe0ee8f97a164463a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e49c74cbe0ee8f97a164463a: done: 0.014746 sec","job_status":"done","queue_duration_s":0.497042,"scheduling_latency_s":0.497059,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014746,"completed_at":"2026-09-04T06:45:09.705Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 266.677112] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94082ac9a182eb0e8623abbb","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94082ac9a182eb0e8623abbb: start","job_status":"start","queue_duration_s":0.512858,"scheduling_latency_s":0.512873}1503gitlab # [ 266.689309] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94082ac9a182eb0e8623abbb","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94082ac9a182eb0e8623abbb: done: 0.01516 sec","job_status":"done","queue_duration_s":0.512858,"scheduling_latency_s":0.512873,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01516,"completed_at":"2026-09-04T06:45:09.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 266.727618] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c36bc2d05ac8bc7373aad03a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c36bc2d05ac8bc7373aad03a: start","job_status":"start","queue_duration_s":0.529146,"scheduling_latency_s":0.529162}1505gitlab # [ 266.740056] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c36bc2d05ac8bc7373aad03a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c36bc2d05ac8bc7373aad03a: done: 0.014911 sec","job_status":"done","queue_duration_s":0.529146,"scheduling_latency_s":0.529162,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014911,"completed_at":"2026-09-04T06:45:09.737Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 266.778438] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df3f4c501b8c6be2ee81027f","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df3f4c501b8c6be2ee81027f: start","job_status":"start","queue_duration_s":0.545147,"scheduling_latency_s":0.545163}1507gitlab # [ 266.790621] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df3f4c501b8c6be2ee81027f","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df3f4c501b8c6be2ee81027f: done: 0.015183 sec","job_status":"done","queue_duration_s":0.545147,"scheduling_latency_s":0.545163,"redis_calls":13,"redis_duration_s":0.001499,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015183,"completed_at":"2026-09-04T06:45:09.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 266.828867] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c5337ba5f637258628322fe","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c5337ba5f637258628322fe: start","job_status":"start","queue_duration_s":0.561417,"scheduling_latency_s":0.561434}1509gitlab # [ 266.840990] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c5337ba5f637258628322fe","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c5337ba5f637258628322fe: done: 0.0143 sec","job_status":"done","queue_duration_s":0.561417,"scheduling_latency_s":0.561434,"redis_calls":13,"redis_duration_s":0.001494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0143,"completed_at":"2026-09-04T06:45:09.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 266.880186] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a24435c2ed5624e3a6c90aff","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a24435c2ed5624e3a6c90aff: start","job_status":"start","queue_duration_s":0.577152,"scheduling_latency_s":0.577168}1511gitlab # [ 266.892237] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a24435c2ed5624e3a6c90aff","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a24435c2ed5624e3a6c90aff: done: 0.014612 sec","job_status":"done","queue_duration_s":0.577152,"scheduling_latency_s":0.577168,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014612,"completed_at":"2026-09-04T06:45:09.785Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 266.930464] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a20defeb2dffea98c0c54906","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a20defeb2dffea98c0c54906: start","job_status":"start","queue_duration_s":0.592807,"scheduling_latency_s":0.592823}1513gitlab # [ 266.942817] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a20defeb2dffea98c0c54906","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a20defeb2dffea98c0c54906: done: 0.014647 sec","job_status":"done","queue_duration_s":0.592807,"scheduling_latency_s":0.592823,"redis_calls":13,"redis_duration_s":0.0014429999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014647,"completed_at":"2026-09-04T06:45:09.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 266.981316] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"156f2b81462ae8c2af13a33a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-156f2b81462ae8c2af13a33a: start","job_status":"start","queue_duration_s":0.608571,"scheduling_latency_s":0.608588}1515gitlab # [ 266.993253] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"156f2b81462ae8c2af13a33a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-156f2b81462ae8c2af13a33a: done: 0.015164 sec","job_status":"done","queue_duration_s":0.608571,"scheduling_latency_s":0.608588,"redis_calls":13,"redis_duration_s":0.001518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015164,"completed_at":"2026-09-04T06:45:09.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 267.031594] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc3cf747c00810b4c5139865","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc3cf747c00810b4c5139865: start","job_status":"start","queue_duration_s":0.624802,"scheduling_latency_s":0.624818}1517gitlab # [ 267.044033] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc3cf747c00810b4c5139865","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc3cf747c00810b4c5139865: done: 0.014849 sec","job_status":"done","queue_duration_s":0.624802,"scheduling_latency_s":0.624818,"redis_calls":13,"redis_duration_s":0.001417,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014849,"completed_at":"2026-09-04T06:45:09.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 267.083300] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e50ef8fc3915d58ae99db0e5","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e50ef8fc3915d58ae99db0e5: start","job_status":"start","queue_duration_s":0.640726,"scheduling_latency_s":0.640741}1519gitlab # [ 267.095420] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e50ef8fc3915d58ae99db0e5","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e50ef8fc3915d58ae99db0e5: done: 0.014318 sec","job_status":"done","queue_duration_s":0.640726,"scheduling_latency_s":0.640741,"redis_calls":13,"redis_duration_s":0.0016879999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014318,"completed_at":"2026-09-04T06:45:09.848Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 267.134067] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09a4131cbb5544c51c0a214c","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09a4131cbb5544c51c0a214c: start","job_status":"start","queue_duration_s":0.656169,"scheduling_latency_s":0.656185}1521gitlab # [ 267.146292] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09a4131cbb5544c51c0a214c","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09a4131cbb5544c51c0a214c: done: 0.014444 sec","job_status":"done","queue_duration_s":0.656169,"scheduling_latency_s":0.656185,"redis_calls":13,"redis_duration_s":0.001456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014444,"completed_at":"2026-09-04T06:45:09.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 267.183974] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba83a0643db8bdd1d38f7f3e","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba83a0643db8bdd1d38f7f3e: start","job_status":"start","queue_duration_s":0.671668,"scheduling_latency_s":0.671684}1523gitlab # [ 267.195997] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba83a0643db8bdd1d38f7f3e","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba83a0643db8bdd1d38f7f3e: done: 0.01451 sec","job_status":"done","queue_duration_s":0.671668,"scheduling_latency_s":0.671684,"redis_calls":13,"redis_duration_s":0.001494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01451,"completed_at":"2026-09-04T06:45:09.879Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 267.233792] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e679f1cc38206769cc89db8a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e679f1cc38206769cc89db8a: start","job_status":"start","queue_duration_s":0.687277,"scheduling_latency_s":0.687294}1525gitlab # [ 267.245892] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e679f1cc38206769cc89db8a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e679f1cc38206769cc89db8a: done: 0.014419 sec","job_status":"done","queue_duration_s":0.687277,"scheduling_latency_s":0.687294,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014419,"completed_at":"2026-09-04T06:45:09.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 267.284587] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"115264281a6197fb516ec7f8","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-115264281a6197fb516ec7f8: start","job_status":"start","queue_duration_s":0.702768,"scheduling_latency_s":0.702785}1527gitlab # [ 267.296513] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"115264281a6197fb516ec7f8","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-115264281a6197fb516ec7f8: done: 0.014785 sec","job_status":"done","queue_duration_s":0.702768,"scheduling_latency_s":0.702785,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014785,"completed_at":"2026-09-04T06:45:09.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 267.334311] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"befff639b83669e8121f9902","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-befff639b83669e8121f9902: start","job_status":"start","queue_duration_s":0.718648,"scheduling_latency_s":0.718664}1529gitlab # [ 267.346258] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"befff639b83669e8121f9902","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-befff639b83669e8121f9902: done: 0.014531 sec","job_status":"done","queue_duration_s":0.718648,"scheduling_latency_s":0.718664,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014531,"completed_at":"2026-09-04T06:45:09.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 267.385002] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d6e596ab591d40db7bc5fb4","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d6e596ab591d40db7bc5fb4: start","job_status":"start","queue_duration_s":0.734298,"scheduling_latency_s":0.734315}1531gitlab # [ 267.397275] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d6e596ab591d40db7bc5fb4","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d6e596ab591d40db7bc5fb4: done: 0.014124 sec","job_status":"done","queue_duration_s":0.734298,"scheduling_latency_s":0.734315,"redis_calls":13,"redis_duration_s":0.0014169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014124,"completed_at":"2026-09-04T06:45:09.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 267.436754] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6707cc9ed0328ab6e6d699d8","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6707cc9ed0328ab6e6d699d8: start","job_status":"start","queue_duration_s":0.750577,"scheduling_latency_s":0.750595}1533gitlab # [ 267.448937] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6707cc9ed0328ab6e6d699d8","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6707cc9ed0328ab6e6d699d8: done: 0.014408 sec","job_status":"done","queue_duration_s":0.750577,"scheduling_latency_s":0.750595,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014408,"completed_at":"2026-09-04T06:45:09.958Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 267.488405] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18f1098003cea49f2b76cbe2","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18f1098003cea49f2b76cbe2: start","job_status":"start","queue_duration_s":0.766206,"scheduling_latency_s":0.766223}1535gitlab # [ 267.500745] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18f1098003cea49f2b76cbe2","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18f1098003cea49f2b76cbe2: done: 0.014099 sec","job_status":"done","queue_duration_s":0.766206,"scheduling_latency_s":0.766223,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014099,"completed_at":"2026-09-04T06:45:09.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 267.539496] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c36ccfa85bfe046208b77f7a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c36ccfa85bfe046208b77f7a: start","job_status":"start","queue_duration_s":0.781341,"scheduling_latency_s":0.781358}1537gitlab # [ 267.551892] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c36ccfa85bfe046208b77f7a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c36ccfa85bfe046208b77f7a: done: 0.014336 sec","job_status":"done","queue_duration_s":0.781341,"scheduling_latency_s":0.781358,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014336,"completed_at":"2026-09-04T06:45:09.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 267.590084] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:09.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5eb0efecddd12db4f061b75","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5eb0efecddd12db4f061b75: start","job_status":"start","queue_duration_s":0.796736,"scheduling_latency_s":0.796753}1539gitlab # [ 267.602407] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5eb0efecddd12db4f061b75","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5eb0efecddd12db4f061b75: done: 0.01439 sec","job_status":"done","queue_duration_s":0.796736,"scheduling_latency_s":0.796753,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01439,"completed_at":"2026-09-04T06:45:10.004Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 267.640545] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a084f55ae91fc5e60832b87","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a084f55ae91fc5e60832b87: start","job_status":"start","queue_duration_s":0.812282,"scheduling_latency_s":0.812298}1541gitlab # [ 267.652617] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a084f55ae91fc5e60832b87","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a084f55ae91fc5e60832b87: done: 0.014327 sec","job_status":"done","queue_duration_s":0.812282,"scheduling_latency_s":0.812298,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014327,"completed_at":"2026-09-04T06:45:10.020Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 267.691606] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"971cf7d5e36955c3ed3b0823","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-971cf7d5e36955c3ed3b0823: start","job_status":"start","queue_duration_s":0.827665,"scheduling_latency_s":0.82768}1543gitlab # [ 267.703993] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"971cf7d5e36955c3ed3b0823","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-971cf7d5e36955c3ed3b0823: done: 0.01414 sec","job_status":"done","queue_duration_s":0.827665,"scheduling_latency_s":0.82768,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01414,"completed_at":"2026-09-04T06:45:10.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 267.742058] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10108a301e5386a0805e4c4e","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10108a301e5386a0805e4c4e: start","job_status":"start","queue_duration_s":0.842953,"scheduling_latency_s":0.842969}1545gitlab # [ 267.754312] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10108a301e5386a0805e4c4e","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10108a301e5386a0805e4c4e: done: 0.014152 sec","job_status":"done","queue_duration_s":0.842953,"scheduling_latency_s":0.842969,"redis_calls":13,"redis_duration_s":0.0014689999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014152,"completed_at":"2026-09-04T06:45:10.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 267.792714] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d790b9692e0b097b5e258cc","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d790b9692e0b097b5e258cc: start","job_status":"start","queue_duration_s":0.858261,"scheduling_latency_s":0.858278}1547gitlab # [ 267.804607] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d790b9692e0b097b5e258cc","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d790b9692e0b097b5e258cc: done: 0.014061 sec","job_status":"done","queue_duration_s":0.858261,"scheduling_latency_s":0.858278,"redis_calls":13,"redis_duration_s":0.001396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014061,"completed_at":"2026-09-04T06:45:10.065Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 267.843286] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab1a813e71e2d1f6b71aa12d","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab1a813e71e2d1f6b71aa12d: start","job_status":"start","queue_duration_s":0.873415,"scheduling_latency_s":0.873431}1549gitlab # [ 267.855371] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab1a813e71e2d1f6b71aa12d","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab1a813e71e2d1f6b71aa12d: done: 0.01429 sec","job_status":"done","queue_duration_s":0.873415,"scheduling_latency_s":0.873431,"redis_calls":13,"redis_duration_s":0.0014949999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01429,"completed_at":"2026-09-04T06:45:10.081Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 267.894723] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3dce84596e12a3113dcd777","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3dce84596e12a3113dcd777: start","job_status":"start","queue_duration_s":0.88875,"scheduling_latency_s":0.888765}1551gitlab # [ 267.907048] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3dce84596e12a3113dcd777","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3dce84596e12a3113dcd777: done: 0.014109 sec","job_status":"done","queue_duration_s":0.88875,"scheduling_latency_s":0.888765,"redis_calls":13,"redis_duration_s":0.001419,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014109,"completed_at":"2026-09-04T06:45:10.096Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 267.945260] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5360c5c67717c521d601f1e6","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5360c5c67717c521d601f1e6: start","job_status":"start","queue_duration_s":0.903936,"scheduling_latency_s":0.903952}1553gitlab # [ 267.957476] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5360c5c67717c521d601f1e6","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5360c5c67717c521d601f1e6: done: 0.014219 sec","job_status":"done","queue_duration_s":0.903936,"scheduling_latency_s":0.903952,"redis_calls":13,"redis_duration_s":0.001577,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014219,"completed_at":"2026-09-04T06:45:10.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 267.995790] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccfb3330eca38df83c4b9c1a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccfb3330eca38df83c4b9c1a: start","job_status":"start","queue_duration_s":0.919412,"scheduling_latency_s":0.919429}1555gitlab # [ 268.007942] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccfb3330eca38df83c4b9c1a","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccfb3330eca38df83c4b9c1a: done: 0.014353 sec","job_status":"done","queue_duration_s":0.919412,"scheduling_latency_s":0.919429,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014353,"completed_at":"2026-09-04T06:45:10.127Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 268.046614] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a12da61fd9a59017b16e4e8","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a12da61fd9a59017b16e4e8: start","job_status":"start","queue_duration_s":0.934893,"scheduling_latency_s":0.934909}1557gitlab # [ 268.058855] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a12da61fd9a59017b16e4e8","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a12da61fd9a59017b16e4e8: done: 0.014232 sec","job_status":"done","queue_duration_s":0.934893,"scheduling_latency_s":0.934909,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014232,"completed_at":"2026-09-04T06:45:10.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 268.098449] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5b328f31b9e44188b002849","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5b328f31b9e44188b002849: start","job_status":"start","queue_duration_s":0.950218,"scheduling_latency_s":0.950234}1559gitlab # [ 268.110883] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5b328f31b9e44188b002849","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5b328f31b9e44188b002849: done: 0.014289 sec","job_status":"done","queue_duration_s":0.950218,"scheduling_latency_s":0.950234,"redis_calls":13,"redis_duration_s":0.001491,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014289,"completed_at":"2026-09-04T06:45:10.157Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 268.149454] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d26d5fdf30b48abfd5d3d5f0","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d26d5fdf30b48abfd5d3d5f0: start","job_status":"start","queue_duration_s":0.965648,"scheduling_latency_s":0.965664}1561gitlab # [ 268.161606] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d26d5fdf30b48abfd5d3d5f0","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d26d5fdf30b48abfd5d3d5f0: done: 0.014283 sec","job_status":"done","queue_duration_s":0.965648,"scheduling_latency_s":0.965664,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014283,"completed_at":"2026-09-04T06:45:10.173Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 268.200353] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d36a3a4e8c6c896538a7c912","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d36a3a4e8c6c896538a7c912: start","job_status":"start","queue_duration_s":0.981181,"scheduling_latency_s":0.981198}1563gitlab # [ 268.212377] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d36a3a4e8c6c896538a7c912","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d36a3a4e8c6c896538a7c912: done: 0.014367 sec","job_status":"done","queue_duration_s":0.981181,"scheduling_latency_s":0.981198,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014367,"completed_at":"2026-09-04T06:45:10.188Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 268.250802] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fc854a706e4edb592d07b2e","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fc854a706e4edb592d07b2e: start","job_status":"start","queue_duration_s":0.996615,"scheduling_latency_s":0.996632}1565gitlab # [ 268.263280] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fc854a706e4edb592d07b2e","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fc854a706e4edb592d07b2e: done: 0.014541 sec","job_status":"done","queue_duration_s":0.996615,"scheduling_latency_s":0.996632,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014541,"completed_at":"2026-09-04T06:45:10.204Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 268.302998] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71d6a19efae2a84c42ff0670","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71d6a19efae2a84c42ff0670: start","job_status":"start","queue_duration_s":1.012261,"scheduling_latency_s":1.012278}1567gitlab # [ 268.315350] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71d6a19efae2a84c42ff0670","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71d6a19efae2a84c42ff0670: done: 0.019938 sec","job_status":"done","queue_duration_s":1.012261,"scheduling_latency_s":1.012278,"redis_calls":13,"redis_duration_s":0.001912,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019938,"completed_at":"2026-09-04T06:45:10.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 268.354162] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92b4399fe87f5a514f64348e","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92b4399fe87f5a514f64348e: start","job_status":"start","queue_duration_s":1.033321,"scheduling_latency_s":1.033338}1569gitlab # [ 268.366481] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92b4399fe87f5a514f64348e","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92b4399fe87f5a514f64348e: done: 0.014298 sec","job_status":"done","queue_duration_s":1.033321,"scheduling_latency_s":1.033338,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014298,"completed_at":"2026-09-04T06:45:10.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 268.405019] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61d23f244f765d3d6253a781","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61d23f244f765d3d6253a781: start","job_status":"start","queue_duration_s":1.048701,"scheduling_latency_s":1.048717}1571gitlab # [ 268.416961] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61d23f244f765d3d6253a781","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61d23f244f765d3d6253a781: done: 0.014621 sec","job_status":"done","queue_duration_s":1.048701,"scheduling_latency_s":1.048717,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014621,"completed_at":"2026-09-04T06:45:10.256Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 268.455291] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63cf51a2024c7e6924b8c165","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63cf51a2024c7e6924b8c165: start","job_status":"start","queue_duration_s":1.064613,"scheduling_latency_s":1.064628}1573gitlab # [ 268.467971] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63cf51a2024c7e6924b8c165","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63cf51a2024c7e6924b8c165: done: 0.014448 sec","job_status":"done","queue_duration_s":1.064613,"scheduling_latency_s":1.064628,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014448,"completed_at":"2026-09-04T06:45:10.272Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574gitlab # [ 268.507501] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d073ba0acac7179bddec6d70","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d073ba0acac7179bddec6d70: start","job_status":"start","queue_duration_s":1.080132,"scheduling_latency_s":1.080148}1575gitlab # [ 268.520078] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:45:10.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d073ba0acac7179bddec6d70","created_at":"2026-09-04T06:45:09.067Z","trace_propagation_headers":{"sentry-trace":"dce513ee688242c29992572474853748-6bdef21309e84d57","baggage":"sentry-trace_id=dce513ee688242c29992572474853748,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23db670c18911e005650f3fbfea7df08","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:45:09.193Z","job_size_bytes":2,"pid":2023,"sidekiq_tid":"maor","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d073ba0acac7179bddec6d70: done: 0.014269 sec","job_status":"done","queue_duration_s":1.080132,"scheduling_latency_s":1.080148,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014269,"completed_at":"2026-09-04T06:45:10.287Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 272.295808] setup-gitlab-start[2986]: W, [2026-09-04T06:45:16.137344 #2986] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1577gitlab # [ 308.238969] redis[793]: 10 changes in 300 seconds. Saving...1578gitlab # [ 308.245332] redis[793]: Background saving started by pid 33111579gitlab # [ 308.251090] redis[3311]: BGSAVE done, 482 keys saved, 0 keys skipped, 122807 bytes written.1580gitlab # [ 308.255996] redis[3311]: DB saved on disk1581gitlab # [ 308.258247] redis[3311]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1582gitlab # [ 308.340039] redis[793]: Background saving terminated with success1583gitlab # [ 310.579034] postgres[867]: [867] LOG: checkpoint starting: time1584gitlab # [ 311.381600] gitaly[908]: time="2026-09-04T06:45:55.222Z" level=info msg="burden monitor stats" pid=9081585gitlab # [ 313.514681] postgres[3312]: [3312] ERROR: relation "table_without_models" does not exist1586gitlab # [ 313.515018] postgres[3312]: [3312] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1587gitlab # [ 319.278820] runuser[2985]: pam_unix(runuser:session): session closed for user gitlab1588gitlab # [ 319.280978] setup-gitlab-start[2967]: + systemctl restart gitlab-sidekiq.service1589gitlab # [ 319.312804] systemd[1]: Stopping gitlab-sidekiq.service...1590gitlab # [ 319.319759] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:46:03.154Z","message":"Shutting down"}1591gitlab # [ 319.323967] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:46:03.155Z","message":"Scheduler exiting..."}1592gitlab # [ 319.327911] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:46:03.156Z","message":"Terminating quiet threads for default capsule"}1593gitlab # [ 319.332998] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:46:03.156Z","message":"Scheduler exiting..."}1594gitlab # [ 319.815630] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:46:03.657Z","message":"Pausing to allow jobs to finish..."}1595gitlab # [ 322.319799] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:46:06.161Z","message":"Bye!"}1596gitlab # [ 322.361824] sidekiq-cluster[2023]: {"severity":"INFO","time":"2026-09-04T06:46:06.204Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2023,"worker_id":"sidekiq_0","memwd_rss_bytes":937304064,"retry":0}1597gitlab # [ 323.728984] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1598gitlab # [ 323.729394] systemd[1]: Stopped gitlab-sidekiq.service.1599gitlab # [ 323.729646] systemd[1]: gitlab-sidekiq.service: Consumed 1min 50.089s CPU time over 3min 21.309s wall clock time, 937.6M memory peak, 4.7M read from disk.1600gitlab # [ 323.742963] systemd[1]: Started gitlab-sidekiq.service.1601gitlab # [ 323.747038] setup-gitlab-start[2967]: + mkdir -p /var/lib/secrets1602gitlab # [ 323.753901] setup-gitlab-start[2967]: + echo nixbot-test-token-of-20-chars1603gitlab # [ 323.756960] setup-gitlab-start[2967]: + chmod 644 /var/lib/secrets/gitlab-token1604gitlab # [ 323.759895] setup-gitlab-start[2967]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1605gitlab # [ 325.792402] gitaly[908]: time="2026-09-04T06:46:09.633Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:46:19.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:09.633" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1606gitlab # [ 325.823014] gitaly[908]: time="2026-09-04T06:46:09.665Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:46:19.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:09.633" grpc.time_ms=32.155 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1607gitlab # [ 326.060191] gitaly[908]: time="2026-09-04T06:46:09.902Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:46:19.281" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:09.902" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1608gitlab # [ 326.079855] gitaly[908]: time="2026-09-04T06:46:09.903Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:46:19.281" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:09.902" grpc.time_ms=0.738 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1609gitlab # [ 326.142286] gitaly[908]: time="2026-09-04T06:46:09.984Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 diskcache=ee55eea3-9147-4fd3-9136-5ae419ded2c8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T06:46:19.006" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:09.917" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1610gitlab # [ 326.165052] gitaly[908]: time="2026-09-04T06:46:09.985Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=35 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=32 command.real_time_ms=43 command.spawn_token_fork_ms=8 command.system_time_ms=29 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T06:46:19.006" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:09.917" grpc.time_ms=68.08 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1611gitlab # [ 326.186609] gitaly[908]: time="2026-09-04T06:46:10.009Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:46:20.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.007" pid=908 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1612gitlab # [ 326.200523] gitaly[908]: time="2026-09-04T06:46:10.009Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:46:20.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.007" grpc.time_ms=1.549 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1613gitlab # [ 326.213831] gitaly[908]: time="2026-09-04T06:46:10.035Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:46:20.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.018" grpc.time_ms=16.589 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 326.311569] gitaly[908]: time="2026-09-04T06:46:10.154Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:46:20.152" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.153" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 326.342604] gitaly[908]: time="2026-09-04T06:46:10.154Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:46:20.152" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.153" grpc.time_ms=0.56 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab # [ 326.374314] gitaly[908]: time="2026-09-04T06:46:10.202Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 diskcache=7d6dc68b-8fef-42d1-9cc1-2aaeb5a44426 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T06:46:20.157" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.157" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1617gitlab # [ 326.395832] gitaly[908]: time="2026-09-04T06:46:10.203Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1442 command.oublock=32 command.real_time_ms=23 command.spawn_token_fork_ms=4 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T06:46:20.157" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.157" grpc.time_ms=44.474 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1618gitlab # [ 326.417205] gitaly[908]: time="2026-09-04T06:46:10.212Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:46:20.209" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.210" pid=908 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1619gitlab # [ 326.431377] gitaly[908]: time="2026-09-04T06:46:10.212Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:46:20.209" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.210" grpc.time_ms=1.94 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 326.446495] gitaly[908]: time="2026-09-04T06:46:10.228Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:46:20.217" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.217" grpc.time_ms=10.969 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 326.465254] gitaly[908]: time="2026-09-04T06:46:10.280Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:46:20.278" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.279" grpc.time_ms=0.46 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab # [ 326.477787] gitaly[908]: time="2026-09-04T06:46:10.293Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T06:46:20.291" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:10.292" grpc.time_ms=0.518 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1623gitlab # [ 327.386253] gitaly[908]: time="2026-09-04T06:46:11.228Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNRGEPC5SW18VGMKQR618 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:46:21.209" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:11.210" grpc.time_ms=17.747 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1624gitlab # [ 328.027435] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:11 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 42371625gitlab # [ 328.034657] setup-gitlab-start[2967]: + mkdir -p /tmp/test-flake1626gitlab # [ 328.037580] setup-gitlab-start[2967]: + cd /tmp/test-flake1627gitlab # [ 328.039832] setup-gitlab-start[2967]: + git init -b master1628gitlab # [ 328.063462] setup-gitlab-start[3436]: Initialized empty Git repository in /tmp/test-flake/.git/1629gitlab # [ 328.067209] setup-gitlab-start[2967]: + git config user.name test1630gitlab # [ 328.070600] setup-gitlab-start[2967]: + git config user.email test@example.com1631gitlab # [ 328.077724] setup-gitlab-start[2967]: + cat1632gitlab # [ 328.083356] setup-gitlab-start[2967]: + git add flake.nix1633gitlab # [ 328.091934] setup-gitlab-start[2967]: + git commit -m 'initial commit'1634gitlab # [ 328.119561] setup-gitlab-start[3441]: [master (root-commit) 1aa3a2d] initial commit1635gitlab # [ 328.123909] setup-gitlab-start[3441]: 1 file changed, 10 insertions(+)1636gitlab # [ 328.126846] setup-gitlab-start[3441]: create mode 100644 flake.nix1637gitlab # [ 328.129568] setup-gitlab-start[2967]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1638gitlab # [ 328.134991] setup-gitlab-start[2967]: + git push -u origin master1639gitlab # [ 328.519206] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:12 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 3371640gitlab # [ 328.760943] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:12 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2391641gitlab # [ 328.766147] gitaly[908]: time="2026-09-04T06:46:12.601Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNX4CVF6YRTJ3DDZAJJYC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:12.584" grpc.time_ms=16.766 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1642gitlab # [ 328.954785] sidekiq-cluster[3379]: {"severity":"INFO","time":"2026-09-04T06:46:12.756Z","message":"Starting cluster with 1 processes"}1643gitlab # [ 329.132699] gitaly[908]: time="2026-09-04T06:46:12.975Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:46:22.049" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:12.960" grpc.time_ms=14.333 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1644gitlab # [ 329.189350] gitaly[908]: time="2026-09-04T06:46:13.031Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T06:46:43.018" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T06:46:13.019" grpc.time_ms=12.332 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1645gitlab # [ 329.229010] gitaly[908]: time="2026-09-04T06:46:13.060Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NJNXCHZM0GTABD166NVMSX duration_ms=194ns method=POST pid=908 status=200 url="http://unix/api/v4/internal/allowed"1646gitlab # [ 329.394019] gitaly[908]: time="2026-09-04T06:46:13.236Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NJNXCHZM0GTABD166NVMSX duration_ms=175ns method=POST pid=908 status=200 url="http://unix/api/v4/internal/pre_receive"1647gitlab # [ 329.397420] gitaly[908]: time="2026-09-04T06:46:13.237Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:12.863" grpc.time_ms=373.829 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1648gitlab # [ 329.454817] gitaly[908]: time="2026-09-04T06:46:13.297Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:13.295" grpc.time_ms=2.099 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1649gitlab # [ 329.512154] gitaly[908]: time="2026-09-04T06:46:13.354Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:13.353" grpc.time_ms=1.157 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1650gitlab # [ 329.567073] gitaly[908]: time="2026-09-04T06:46:13.409Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:13.408" grpc.time_ms=0.861 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1651gitlab # [ 329.768958] gitaly[908]: time="2026-09-04T06:46:13.610Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:46:23.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:13.593" grpc.time_ms=16.829 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1652gitlab # [ 329.819944] gitaly[908]: time="2026-09-04T06:46:13.662Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=5 command.system_time_ms=19 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T06:46:23.003" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:46:13.624" grpc.time_ms=37.81 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1653gitlab # [ 329.861387] gitaly[908]: time="2026-09-04T06:46:13.678Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NJNXCHZM0GTABD166NVMSX duration_ms=188ns method=POST pid=908 status=200 url="http://unix/api/v4/internal/post_receive"1654gitlab # [ 329.869394] gitaly[908]: time="2026-09-04T06:46:13.680Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:13.489" grpc.time_ms=190.958 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1655gitlab # [ 329.891258] gitaly[908]: time="2026-09-04T06:46:13.690Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX diskcache=a9a67b48-df54-4818-bbc9-af67e4adc97e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:12.762" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1656gitlab # [ 329.908736] setup-gitlab-start[3445]: To http://gitlab/root/test-flake.git1657gitlab # [ 329.910300] setup-gitlab-start[3445]: * [new branch] master -> master1658gitlab # [ 329.911842] setup-gitlab-start[3445]: branch 'master' set up to track 'origin/master'.1659gitlab # [ 329.914275] gitlab-workhorse[826]: time="2026-09-04T06:46:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521660gitlab # [ 329.917533] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:13 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 10661661gitlab # [ 329.921161] systemd[1]: Finished setup-gitlab.service.1662gitlab # [ 329.922347] gitaly[908]: time="2026-09-04T06:46:13.691Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=303 command.inblock=8 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13176 command.oublock=32 command.real_time_ms=918 command.spawn_token_fork_ms=2 command.system_time_ms=211 command.user_time_ms=92 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:12.762" grpc.time_ms=928.459 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1663gitlab # [ 329.942232] systemd[1]: Starting nixbot CI service...1664gitlab: (finished: waiting for unit setup-gitlab.service, in 331.39 seconds)1665gitlab: waiting for unit nixbot.service1666gitlab # [ 331.322104] nixbot[3533]: {"ts": "2026-09-04T06:46:15.163Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1667gitlab # [ 331.347313] nixbot[3533]: {"ts": "2026-09-04T06:46:15.189Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1668gitlab # [ 331.364123] nixbot[3533]: {"ts": "2026-09-04T06:46:15.206Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1669gitlab # [ 331.370749] nixbot[3533]: {"ts": "2026-09-04T06:46:15.211Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1670gitlab # [ 331.377716] nixbot[3533]: {"ts": "2026-09-04T06:46:15.216Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1671gitlab # [ 331.385066] nixbot[3533]: {"ts": "2026-09-04T06:46:15.221Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1672gitlab # [ 331.391496] nixbot[3533]: {"ts": "2026-09-04T06:46:15.226Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1673gitlab # [ 331.398081] nixbot[3533]: {"ts": "2026-09-04T06:46:15.227Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1674gitlab # [ 331.404486] nixbot[3533]: {"ts": "2026-09-04T06:46:15.233Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1675gitlab # [ 331.411161] nixbot[3533]: {"ts": "2026-09-04T06:46:15.235Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1676gitlab # [ 331.418130] nixbot[3533]: {"ts": "2026-09-04T06:46:15.239Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1677gitlab # [ 331.424656] nixbot[3533]: {"ts": "2026-09-04T06:46:15.245Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1678gitlab # [ 331.431141] nixbot[3533]: {"ts": "2026-09-04T06:46:15.248Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1679gitlab # [ 331.438128] nixbot[3533]: {"ts": "2026-09-04T06:46:15.250Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1680gitlab # [ 331.444738] nixbot[3533]: {"ts": "2026-09-04T06:46:15.254Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1681gitlab # [ 331.450581] nixbot[3533]: {"ts": "2026-09-04T06:46:15.256Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1682gitlab # [ 331.455905] nixbot[3533]: {"ts": "2026-09-04T06:46:15.258Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1683gitlab # [ 331.461713] nixbot[3533]: {"ts": "2026-09-04T06:46:15.260Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1684gitlab # [ 331.466707] nixbot[3533]: {"ts": "2026-09-04T06:46:15.264Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1685gitlab # [ 331.471943] nixbot[3533]: {"ts": "2026-09-04T06:46:15.266Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1686gitlab # [ 331.476818] nixbot[3533]: {"ts": "2026-09-04T06:46:15.268Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1687gitlab # [ 331.481725] nixbot[3533]: {"ts": "2026-09-04T06:46:15.272Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1688gitlab # [ 331.490242] nixbot[3533]: {"ts": "2026-09-04T06:46:15.274Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1689gitlab # [ 331.493888] nixbot[3533]: {"ts": "2026-09-04T06:46:15.276Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1690gitlab # [ 331.497375] nixbot[3533]: {"ts": "2026-09-04T06:46:15.278Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1691gitlab # [ 331.500747] nixbot[3533]: {"ts": "2026-09-04T06:46:15.280Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1692gitlab # [ 331.503883] nixbot[3533]: {"ts": "2026-09-04T06:46:15.282Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1693gitlab # [ 331.507748] nixbot[3533]: {"ts": "2026-09-04T06:46:15.283Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1694gitlab # [ 331.511290] nixbot[3533]: {"ts": "2026-09-04T06:46:15.284Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1695gitlab # [ 331.514826] nixbot[3533]: {"ts": "2026-09-04T06:46:15.295Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1696gitlab # [ 331.518438] nixbot[3533]: {"ts": "2026-09-04T06:46:15.300Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1697gitlab # [ 331.521741] nixbot[3533]: {"ts": "2026-09-04T06:46:15.301Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1698gitlab # [ 331.784574] nixbot[3533]: INFO: Started server process [3533]1699gitlab # [ 331.787915] nixbot[3533]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1700gitlab # [ 331.812006] nixbot[3533]: INFO: ::ffff:127.0.0.1:36192 - "GET /health HTTP/1.1" 200 OK1701gitlab # [ 331.819437] systemd[1]: Started nixbot CI service.1702gitlab # [ 331.821065] systemd[1]: Reached target Multi-User System.1703gitlab # [ 331.822325] systemd[1]: Startup finished in 736ms (kernel) + 3.411s (initrd) + 5min 27.675s (userspace) = 5min 31.822s.1704gitlab: (finished: waiting for unit nixbot.service, in 1.11 seconds)1705gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1706gitlab # [ 332.072234] nixbot[3533]: INFO: ::ffff:127.0.0.1:53782 - "GET /health HTTP/1.1" 200 OK1707gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1708subtest: project discovered and webhook registered1709gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1710gitlab # [ 332.251945] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1151711gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds)1712gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1713gitlab # [ 333.427372] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1151714gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.17 seconds)1715gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1716gitlab # [ 334.591577] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1061717gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds)1718gitlab # [ 334.800642] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:18 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 29891719gitlab # [ 334.808902] nixbot[3533]: {"ts": "2026-09-04T06:46:18.646Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1720gitlab # [ 334.844348] nixbot[3533]: {"ts": "2026-09-04T06:46:18.686Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1721gitlab # [ 334.969113] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1171722gitlab # [ 334.975945] nixbot[3533]: {"ts": "2026-09-04T06:46:18.815Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1723gitlab # [ 334.982769] nixbot[3533]: {"ts": "2026-09-04T06:46:18.818Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1724gitlab # [ 335.141245] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1611725gitlab # [ 335.148050] nixbot[3533]: {"ts": "2026-09-04T06:46:18.984Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1726gitlab # [ 335.549088] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:19 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3981727gitlab # [ 335.556339] nixbot[3533]: {"ts": "2026-09-04T06:46:19.393Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1728gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1729gitlab # [ 335.739775] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 1711730gitlab # [ 335.742543] nixbot[3533]: {"ts": "2026-09-04T06:46:19.583Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1731gitlab # [ 335.771354] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 1341732gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds)1733(finished: subtest: project discovered and webhook registered, in 3.70 seconds)1734subtest: push delivers the webhook1735gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1736gitlab # [ 335.850601] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:19 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 1001737gitlab # [ 335.856195] nixbot[3533]: {"ts": "2026-09-04T06:46:19.697Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1738gitlab # [ 335.928166] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 581739gitlab # [ 335.990068] gitaly[908]: time="2026-09-04T06:46:19.831Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP49ZAHJ867DM51F3HXB1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-04T06:46:49.007" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:46:19.807" grpc.time_ms=23.262 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1740gitlab # [ 336.054526] gitaly[908]: time="2026-09-04T06:46:19.897Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP49ZAHJ867DM51F3HXB1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:46:49.095" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:46:19.895" grpc.time_ms=0.945 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1741gitlab # [ 336.090401] gitaly[908]: time="2026-09-04T06:46:19.912Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4C39WMGGM222PA5RY31 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:19.890" grpc.time_ms=21.06 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1742gitlab # Enumerating objects: 5, done.1743gitlab # [ 336.120974] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1321744gitlab # Counting objects: 20% (1/5)[ 336.125387] gitaly[908]: time="2026-09-04T06:46:19.929Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=5 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP49ZAHJ867DM51F3HXB1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-04T06:46:29.002" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:46:19.912" grpc.time_ms=16.47 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # Counting objects: 40% (2/5)[ 336.147703] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2771746gitlab # Counting objects: 60% (3/5)[ 336.152048] nixbot[3533]: {"ts": "2026-09-04T06:46:19.991Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1747gitlab # Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1748gitlab # Delta compression using up to 4 threads1749gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1750gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 91.00 KiB/s, done.1751gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1752gitlab # [ 336.300197] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1461753gitlab # [ 336.304071] nixbot[3533]: {"ts": "2026-09-04T06:46:20.144Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1754gitlab # [ 336.316569] nixbot[3533]: {"ts": "2026-09-04T06:46:20.159Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1755gitlab # [ 336.439490] gitaly[908]: time="2026-09-04T06:46:20.282Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4SB9V2BSR0TGE98XENK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.270" grpc.time_ms=11.941 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1756gitlab # [ 336.454305] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 851757gitlab # [ 336.556158] gitaly[908]: time="2026-09-04T06:46:20.396Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T06:46:50.074" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T06:46:20.375" grpc.time_ms=20.656 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 336.598641] gitaly[908]: time="2026-09-04T06:46:20.441Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM duration_ms=176ns method=POST pid=908 status=200 url="http://unix/api/v4/internal/allowed"1759gitlab # [ 336.645697] gitaly[908]: time="2026-09-04T06:46:20.488Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM duration_ms=46ns method=POST pid=908 status=200 url="http://unix/api/v4/internal/pre_receive"1760gitlab # [ 336.651704] gitaly[908]: time="2026-09-04T06:46:20.488Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:20.263" grpc.time_ms=224.98 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1761gitlab # [ 336.698461] gitaly[908]: time="2026-09-04T06:46:20.541Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:20.539" grpc.time_ms=1.333 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1762gitlab # [ 336.749521] gitaly[908]: time="2026-09-04T06:46:20.592Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:20.590" grpc.time_ms=0.818 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1763gitlab # [ 336.788964] gitaly[908]: time="2026-09-04T06:46:20.631Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP4WB7F7M2VTXK3H0VAA8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.614" pid=908 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1764gitlab # [ 336.803295] gitaly[908]: time="2026-09-04T06:46:20.631Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP4WB7F7M2VTXK3H0VAA8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.614" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1765gitlab # [ 336.819027] gitlab-workhorse[826]: time="2026-09-04T06:46:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131766gitlab # [ 336.821191] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 3321767gitlab # [ 336.823162] gitaly[908]: time="2026-09-04T06:46:20.631Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP4WB7F7M2VTXK3H0VAA8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.614" grpc.time_ms=16.504 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1768gitlab # [ 336.838073] gitaly[908]: time="2026-09-04T06:46:20.640Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:20.639" grpc.time_ms=0.826 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1769gitlab # [ 336.898284] gitaly[908]: time="2026-09-04T06:46:20.741Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP56Y6AK7KYJ1CXD75C1G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.716" pid=908 remote_ip="2001:db8:1::1" request_sha=9ee31e1c431591d86681545e768d82174b3d40cf response_bytes=417 span.kind=server system=grpc1770gitlab # [ 336.910420] gitaly[908]: time="2026-09-04T06:46:20.741Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP56Y6AK7KYJ1CXD75C1G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.716" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1771gitlab # [ 336.926632] gitlab-workhorse[826]: time="2026-09-04T06:46:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4171772gitlab # [ 336.928697] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 417 "" "git/2.55.0" 1031773gitlab # [ 336.930752] gitaly[908]: time="2026-09-04T06:46:20.741Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP56Y6AK7KYJ1CXD75C1G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.716" grpc.time_ms=25.102 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1774gitlab # [ 336.971743] gitaly[908]: time="2026-09-04T06:46:20.814Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM duration_ms=121ns method=POST pid=908 status=200 url="http://unix/api/v4/internal/post_receive"1775gitlab # [ 336.978498] gitaly[908]: time="2026-09-04T06:46:20.815Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:20.690" grpc.time_ms=125.344 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1776gitlab # To http://gitlab/root/test-flake.git1777gitlab # 1aa3a2d..b90a294 master -> master1778gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.24 seconds)1779gitlab: must succeed: git -C /tmp/test-flake rev-parse master1780gitlab # [ 337.000885] gitaly[908]: time="2026-09-04T06:46:20.827Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM diskcache=ba5baf5c-1907-44a8-90ea-23a9a296bcd4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.167" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1781gitlab # [ 337.019148] gitlab-workhorse[826]: time="2026-09-04T06:46:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521782gitlab # [ 337.023727] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:20 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 8111783gitlab # [ 337.025949] gitaly[908]: time="2026-09-04T06:46:20.827Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=213 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13215 command.oublock=32 command.real_time_ms=651 command.spawn_token_fork_ms=2 command.system_time_ms=116 command.user_time_ms=97 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.167" grpc.time_ms=660.026 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1784gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1785gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1786gitlab # [ 337.040350] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 731787gitlab # [ 337.042381] gitaly[908]: time="2026-09-04T06:46:20.861Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP5BMVFSZKJ4MKPGGJZHN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.852" grpc.time_ms=9.593 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1788gitlab # [ 337.095434] gitaly[908]: time="2026-09-04T06:46:20.937Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5E2RCG0DZNWTD9TF96J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.929" pid=908 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1789gitlab # [ 337.109149] gitaly[908]: time="2026-09-04T06:46:20.938Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5E2RCG0DZNWTD9TF96J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.929" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1790gitlab # [ 337.125597] gitlab-workhorse[826]: time="2026-09-04T06:46:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671791gitlab # [ 337.127727] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 841792gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.10 seconds)1793gitlab # [ 337.130062] gitaly[908]: time="2026-09-04T06:46:20.951Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5E2RCG0DZNWTD9TF96J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:20.929" grpc.time_ms=21.461 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1794gitlab # [ 337.146492] nixbot[3533]: INFO: ::ffff:127.0.0.1:53796 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1795gitlab # [ 337.220866] gitaly[908]: time="2026-09-04T06:46:21.063Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP5J6SNXJTTQTCRV7YWFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:21.051" grpc.time_ms=11.448 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1796gitlab # [ 337.251166] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:21 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 641797gitlab # [ 337.314109] gitaly[908]: time="2026-09-04T06:46:21.156Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5M9G5XQ07B8WX69CXJX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:21.125" pid=908 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1798gitlab # [ 337.345519] gitaly[908]: time="2026-09-04T06:46:21.156Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=1 command.system_time_ms=22 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5M9G5XQ07B8WX69CXJX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:21.125" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1799gitlab # [ 337.375182] gitlab-workhorse[826]: time="2026-09-04T06:46:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091800gitlab # [ 337.379174] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:21 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 911801gitlab # [ 337.383314] gitaly[908]: time="2026-09-04T06:46:21.157Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=1 command.system_time_ms=22 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5M9G5XQ07B8WX69CXJX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:21.125" grpc.time_ms=32.014 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1802gitlab # [ 337.441794] gitaly[908]: time="2026-09-04T06:46:21.284Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:46:51.282" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:46:21.283" grpc.time_ms=0.892 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 337.495657] gitaly[908]: time="2026-09-04T06:46:21.338Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T06:46:51.325" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:46:21.326" grpc.time_ms=11.737 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 337.533646] gitaly[908]: time="2026-09-04T06:46:21.369Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:46:31.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:46:21.355" grpc.time_ms=13.412 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 337.560514] gitaly[908]: time="2026-09-04T06:46:21.391Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:46:31.029" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:46:21.380" grpc.time_ms=11.081 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 337.635118] gitaly[908]: time="2026-09-04T06:46:21.477Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T06:46:31.125" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:21.476" grpc.time_ms=0.637 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 337.660788] gitaly[908]: time="2026-09-04T06:46:21.498Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T06:46:31.134" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:46:21.484" grpc.time_ms=13.497 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 337.706509] gitaly[908]: time="2026-09-04T06:46:21.549Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:21.547" grpc.time_ms=1.126 pid=908 span.kind=server system=grpc1809gitlab # [ 337.738229] gitaly[908]: time="2026-09-04T06:46:21.580Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:46:21.580" grpc.time_ms=0.454 pid=908 span.kind=server system=grpc1810gitlab # [ 337.762513] gitaly[908]: time="2026-09-04T06:46:21.588Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y diskcache=eee9a1df-3ded-4751-b744-f5305ebffe19 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:46:31.150" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:21.501" pid=908 ref=refs/keep-around/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 remote_ip="2001:db8:1::1" revision=1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 span.kind=server system=grpc username=root1811gitlab # [ 337.785961] gitaly[908]: time="2026-09-04T06:46:21.588Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=77 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5343 command.oublock=8 command.real_time_ms=81 command.spawn_token_fork_ms=1 command.system_time_ms=57 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:46:31.150" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:46:21.501" grpc.time_ms=87.547 pid=908 ref=refs/keep-around/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 remote_ip="2001:db8:1::1" revision=1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 span.kind=server system=grpc username=root1812gitlab # [ 337.811793] gitaly[908]: time="2026-09-04T06:46:21.592Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:46:51.592" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:46:21.592" grpc.time_ms=0.31 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 337.998717] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 6321814gitlab # [ 338.007077] nixbot[3533]: {"ts": "2026-09-04T06:46:21.842Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 \"HTTP/1.1 201 Created\""}1815gitlab # [ 338.015751] nixbot[3533]: {"ts": "2026-09-04T06:46:21.858Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-1aa3a2d12d76-0"}1816gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1817gitlab # [ 338.200365] nixbot[3533]: INFO: ::ffff:127.0.0.1:53804 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1818gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1819gitlab # [ 338.302193] nixbot[3533]: {"ts": "2026-09-04T06:46:22.144Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-1aa3a2d12d76-0", "argv0": "bwrap"}1820gitlab # [ 338.466727] systemd[1]: Started Nix Daemon.1821gitlab # [ 338.605069] nix-daemon[3775]: accepted connection from pid 3770, user nixbot1822gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1823gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1824gitlab # [ 339.260954] nixbot[3533]: INFO: ::ffff:127.0.0.1:53816 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1825gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1826gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1827gitlab # [ 340.315486] nixbot[3533]: INFO: ::ffff:127.0.0.1:53832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1828gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1829gitlab # [ 341.371126] nixbot[3533]: INFO: ::ffff:127.0.0.1:43996 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1830gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1831gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1832gitlab # [ 342.427794] nixbot[3533]: INFO: ::ffff:127.0.0.1:43998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1833gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1834gitlab # [ 343.002928] nix-daemon[3775]: accepted connection from pid 3798, user nixbot1835gitlab # [ 343.024428] nix-daemon[3775]: accepted connection from pid 3770, user nixbot1836gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1837gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1838gitlab # [ 343.484668] nixbot[3533]: INFO: ::ffff:127.0.0.1:44012 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1839gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1840gitlab # [ 344.529638] nixbot[3533]: INFO: ::ffff:127.0.0.1:44020 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1841gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1842gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1843gitlab # [ 345.585752] nixbot[3533]: INFO: ::ffff:127.0.0.1:44034 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1844gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1845gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1846gitlab # [ 346.642070] nixbot[3533]: INFO: ::ffff:127.0.0.1:44050 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1847gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1848gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1849gitlab # [ 347.657123] nix-daemon[3775]: accepted connection from pid 3770, user nixbot1850gitlab # [ 347.704722] nixbot[3533]: INFO: ::ffff:127.0.0.1:44064 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1851gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1852gitlab # [ 347.830286] gitaly[908]: time="2026-09-04T06:46:31.672Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPFXKT5TSTDNY0S6QSSZ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:47:01.670" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:46:31.671" grpc.time_ms=1.057 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 347.899769] gitaly[908]: time="2026-09-04T06:46:31.742Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJPFXKT5TSTDNY0S6QSSZ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:46:41.140" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:46:31.731" grpc.time_ms=10.526 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1854gitlab # [ 347.991217] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2291855gitlab # [ 347.996003] nixbot[3533]: {"ts": "2026-09-04T06:46:31.835Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 \"HTTP/1.1 201 Created\""}1856gitlab # [ 348.071737] gitaly[908]: time="2026-09-04T06:46:31.914Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPG531AWGCWENW7Z5A2JD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:47:01.012" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:46:31.913" grpc.time_ms=1.088 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857gitlab # [ 348.117574] gitaly[908]: time="2026-09-04T06:46:31.960Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJPG531AWGCWENW7Z5A2JD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:46:41.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:46:31.948" grpc.time_ms=11.043 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858gitlab # [ 348.227327] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:32 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2251859gitlab # [ 348.235518] nixbot[3533]: {"ts": "2026-09-04T06:46:32.071Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 \"HTTP/1.1 201 Created\""}1860gitlab # [ 348.358542] gitaly[908]: time="2026-09-04T06:46:32.201Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPGCS22R9360JAN4P6RZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:47:02.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:46:32.199" grpc.time_ms=1.268 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1861gitlab # [ 348.591911] gitaly[908]: time="2026-09-04T06:46:32.434Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJPGCS22R9360JAN4P6RZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:46:42.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:46:32.416" grpc.time_ms=17.293 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1863gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1864gitlab # [ 348.767760] nixbot[3533]: INFO: ::ffff:127.0.0.1:44076 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1865gitlab # [ 348.792816] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:32 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 5451866gitlab # [ 348.801101] nixbot[3533]: {"ts": "2026-09-04T06:46:32.636Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 \"HTTP/1.1 201 Created\""}1867gitlab # [ 349.334056] gitaly[908]: time="2026-09-04T06:46:33.176Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NJPHCCWCGBK95FFNT1T1Z2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.161" grpc.time_ms=14.568 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1868gitlab # [ 349.350769] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:33 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 771869gitlab # [ 349.465912] gitaly[908]: time="2026-09-04T06:46:33.308Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPHEXH8B6C4ETZQNMMNKW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.289" pid=908 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1870gitlab # [ 349.485386] gitaly[908]: time="2026-09-04T06:46:33.308Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPHEXH8B6C4ETZQNMMNKW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.289" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1871gitlab # [ 349.508191] gitlab-workhorse[826]: time="2026-09-04T06:46:33Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671872gitlab # [ 349.511205] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:33 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1281873gitlab # [ 349.514454] gitaly[908]: time="2026-09-04T06:46:33.309Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPHEXH8B6C4ETZQNMMNKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.289" grpc.time_ms=19.17 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1874gitlab # [ 349.627387] gitaly[908]: time="2026-09-04T06:46:33.470Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJPHMV9QH0ECHYHR4DXHRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.459" grpc.time_ms=10.121 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1875gitlab # [ 349.641811] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:33 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 981876gitlab # [ 349.721546] gitaly[908]: time="2026-09-04T06:46:33.564Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPHR0RDDBWFQ93KHR988Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.555" pid=908 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1877gitlab # [ 349.732575] gitaly[908]: time="2026-09-04T06:46:33.574Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPHR0RDDBWFQ93KHR988Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.555" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1878gitlab # [ 349.747880] gitaly[908]: time="2026-09-04T06:46:33.575Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPHR0RDDBWFQ93KHR988Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.555" grpc.time_ms=19.931 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1879gitlab # [ 349.762826] gitlab-workhorse[826]: time="2026-09-04T06:46:33Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671880gitlab # [ 349.764742] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:33 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1031881gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1882gitlab # [ 349.805940] nixbot[3533]: INFO: ::ffff:127.0.0.1:44078 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1883gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.04 seconds)1884gitlab # [ 349.839937] gitaly[908]: time="2026-09-04T06:46:33.682Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJPHWJAJ7X21GMFT8NXX22 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.673" grpc.time_ms=9.356 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1885gitlab # [ 349.856734] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:33 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 641886gitlab # [ 349.910659] gitaly[908]: time="2026-09-04T06:46:33.753Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPHYM2K1ZY1XKBP00NRPY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.738" pid=908 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1887gitlab # [ 349.923285] gitaly[908]: time="2026-09-04T06:46:33.753Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPHYM2K1ZY1XKBP00NRPY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.738" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1888gitlab # [ 349.938125] gitlab-workhorse[826]: time="2026-09-04T06:46:33Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161889gitlab # [ 349.940239] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:46:33 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 691890gitlab # [ 349.942276] gitaly[908]: time="2026-09-04T06:46:33.754Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJPHYM2K1ZY1XKBP00NRPY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:46:33.738" grpc.time_ms=14.941 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc1891gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1892gitlab # [ 350.865211] nixbot[3533]: INFO: ::ffff:127.0.0.1:48172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1893gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1894gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1895gitlab # [ 351.924253] nixbot[3533]: INFO: ::ffff:127.0.0.1:48174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1896gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1897gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1898gitlab # [ 352.981320] nixbot[3533]: INFO: ::ffff:127.0.0.1:48182 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1899gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1900gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1901gitlab # [ 354.037916] nixbot[3533]: INFO: ::ffff:127.0.0.1:48194 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1902gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1903gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1904gitlab # [ 355.095208] nixbot[3533]: INFO: ::ffff:127.0.0.1:48202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1905gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1906gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1907gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1908gitlab # [ 356.152160] nixbot[3533]: INFO: ::ffff:127.0.0.1:48206 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1909gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1910gitlab # [ 357.206437] nixbot[3533]: INFO: ::ffff:127.0.0.1:48218 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1911gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1912gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1913gitlab # [ 358.261868] nixbot[3533]: INFO: ::ffff:127.0.0.1:48228 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1915gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1916gitlab # [ 359.317197] nixbot[3533]: INFO: ::ffff:127.0.0.1:48234 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1917gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1918gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1919gitlab # [ 360.374099] nixbot[3533]: INFO: ::ffff:127.0.0.1:48238 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1920gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1921gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1922gitlab # [ 361.430111] nixbot[3533]: INFO: ::ffff:127.0.0.1:51698 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1923gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1924gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1925gitlab # [ 362.485404] nixbot[3533]: INFO: ::ffff:127.0.0.1:51710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1926gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1927gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1928gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1929gitlab # [ 363.541404] nixbot[3533]: INFO: ::ffff:127.0.0.1:51724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1930gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1931gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1932gitlab # [ 364.594286] nixbot[3533]: INFO: ::ffff:127.0.0.1:51726 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1933gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1934gitlab # [ 365.647336] nixbot[3533]: INFO: ::ffff:127.0.0.1:51732 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1935gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1936gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1937gitlab # [ 366.702795] nixbot[3533]: INFO: ::ffff:127.0.0.1:51738 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1938gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1939gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1940gitlab # [ 367.758556] nixbot[3533]: INFO: ::ffff:127.0.0.1:51744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1941gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1942gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1943gitlab # [ 368.816934] nixbot[3533]: INFO: ::ffff:127.0.0.1:51760 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1944gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1945gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1946gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1947gitlab # [ 369.873080] nixbot[3533]: INFO: ::ffff:127.0.0.1:51776 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1948gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1949gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1950gitlab # [ 370.922013] nixbot[3533]: INFO: ::ffff:127.0.0.1:60560 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1951gitlab # [ 371.851378] sidekiq-cluster[3467]: 2026-09-04T06:46:55.692Z pid=3467 tid=ylf INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3467, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>424009728}1952gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1953gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1954gitlab # [ 371.974633] nixbot[3533]: INFO: ::ffff:127.0.0.1:60562 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1955gitlab # [ 372.135713] sidekiq-cluster[3467]: W, [2026-09-04T06:46:55.978375 #3467] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1956gitlab # [ 372.270465] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:46:56.113Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1957gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1958gitlab # [ 373.030137] nixbot[3533]: INFO: ::ffff:127.0.0.1:60568 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1959gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1960gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1961gitlab # [ 374.086419] nixbot[3533]: INFO: ::ffff:127.0.0.1:60582 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1962gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1963gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1964gitlab # [ 375.142815] nixbot[3533]: INFO: ::ffff:127.0.0.1:60588 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1965gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1966gitlab # [ 375.198574] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:46:59.040Z","message":"GitLab reliable fetch activated!"}1967gitlab # [ 375.203570] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:46:59.040Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1968gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1969gitlab # [ 376.199376] nixbot[3533]: INFO: ::ffff:127.0.0.1:60602 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1970gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1971gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1972gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1973gitlab # [ 377.255458] nixbot[3533]: INFO: ::ffff:127.0.0.1:60604 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1974gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1975gitlab # [ 378.309044] nixbot[3533]: INFO: ::ffff:127.0.0.1:60606 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1976gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1977gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1978gitlab # [ 379.365216] nixbot[3533]: INFO: ::ffff:127.0.0.1:60618 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1979gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1980gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1981gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1982gitlab # [ 380.422810] nixbot[3533]: INFO: ::ffff:127.0.0.1:60622 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1983gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1984gitlab # [ 381.477088] nixbot[3533]: INFO: ::ffff:127.0.0.1:34944 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1986gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1987gitlab # [ 382.533702] nixbot[3533]: INFO: ::ffff:127.0.0.1:34956 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1988gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1989gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1990gitlab # [ 383.589744] nixbot[3533]: INFO: ::ffff:127.0.0.1:34960 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1992gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1993gitlab # [ 384.645853] nixbot[3533]: INFO: ::ffff:127.0.0.1:34962 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)1997gitlab # [ 385.701798] nixbot[3533]: INFO: ::ffff:127.0.0.1:34970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK1998gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'1999gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2000gitlab # [ 386.756091] nixbot[3533]: INFO: ::ffff:127.0.0.1:34982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2001gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2002gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2003gitlab # [ 387.809129] nixbot[3533]: INFO: ::ffff:127.0.0.1:34994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2004gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2005gitlab # [ 388.862698] nixbot[3533]: INFO: ::ffff:127.0.0.1:35002 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2006gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2007gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2008gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2009gitlab # [ 389.918278] nixbot[3533]: INFO: ::ffff:127.0.0.1:35008 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2010gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2011gitlab # [ 390.972794] nixbot[3533]: INFO: ::ffff:127.0.0.1:56164 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2012gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2015gitlab # [ 392.030049] nixbot[3533]: INFO: ::ffff:127.0.0.1:56174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2017gitlab # [ 393.083638] nixbot[3533]: INFO: ::ffff:127.0.0.1:56188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2020gitlab # [ 394.143229] nixbot[3533]: INFO: ::ffff:127.0.0.1:56204 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2022gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2023gitlab # [ 395.199050] nixbot[3533]: INFO: ::ffff:127.0.0.1:56210 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2024gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2025gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2026gitlab # [ 396.255460] nixbot[3533]: INFO: ::ffff:127.0.0.1:56218 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2027gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2028gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2029gitlab # [ 397.311265] nixbot[3533]: INFO: ::ffff:127.0.0.1:56226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2030gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2031gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2032gitlab # [ 398.367534] nixbot[3533]: INFO: ::ffff:127.0.0.1:56236 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2033gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2034gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2035gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2036gitlab # [ 399.422616] nixbot[3533]: INFO: ::ffff:127.0.0.1:56238 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2037gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2038gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2039gitlab # [ 400.476748] nixbot[3533]: INFO: ::ffff:127.0.0.1:56252 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2040gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2041gitlab # [ 401.531769] nixbot[3533]: INFO: ::ffff:127.0.0.1:57716 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2042gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2043gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2044gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2045gitlab # [ 402.586908] nixbot[3533]: INFO: ::ffff:127.0.0.1:57722 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2046gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2047gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2048gitlab # [ 403.641011] nixbot[3533]: INFO: ::ffff:127.0.0.1:57732 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2049gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2050gitlab # [ 404.695112] nixbot[3533]: INFO: ::ffff:127.0.0.1:57746 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2051gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2052gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2053gitlab # [ 405.748078] nixbot[3533]: INFO: ::ffff:127.0.0.1:57760 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2054gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2055gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2056gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2057gitlab # [ 406.803324] nixbot[3533]: INFO: ::ffff:127.0.0.1:57774 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2058gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2059gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2060gitlab # [ 407.857897] nixbot[3533]: INFO: ::ffff:127.0.0.1:57778 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2061gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2062gitlab # [ 408.910662] nixbot[3533]: INFO: ::ffff:127.0.0.1:57784 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2063gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2064gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2065gitlab # [ 409.963402] nixbot[3533]: INFO: ::ffff:127.0.0.1:57790 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2066gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2067gitlab # [ 410.627385] postgres[4118]: [4118] ERROR: relation "table_without_models" does not exist2068gitlab # [ 410.627727] postgres[4118]: [4118] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2069gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2070gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2071gitlab # [ 411.019340] nixbot[3533]: INFO: ::ffff:127.0.0.1:55338 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2072gitlab # [ 411.841554] sidekiq-cluster[3467]: InitializerConnections Query: SET client_min_messages TO 'warning'2073gitlab # [ 411.841968] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2074gitlab # [ 411.842090] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2075gitlab # [ 411.842191] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2076gitlab # [ 411.842300] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2077gitlab # [ 411.842414] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2078gitlab # [ 411.842561] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2079gitlab # [ 411.842710] sidekiq-cluster[3467]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2080gitlab # [ 411.842875] sidekiq-cluster[3467]: InitializerConnections Query: SET standard_conforming_strings = on2081gitlab # [ 411.842976] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2082gitlab # [ 411.843070] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2083gitlab # [ 411.843165] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2084gitlab # [ 411.843258] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2085gitlab # [ 411.843350] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2086gitlab # [ 411.843444] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2087gitlab # [ 411.843566] sidekiq-cluster[3467]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2088gitlab # [ 411.907970] sidekiq-cluster[3467]: InitializerConnections Query: SET intervalstyle = iso_86012089gitlab # [ 411.910682] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2090gitlab # [ 411.914244] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2091gitlab # [ 411.917285] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2092gitlab # [ 411.920493] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2093gitlab # [ 411.923349] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2094gitlab # [ 411.926405] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2095gitlab # [ 411.930201] sidekiq-cluster[3467]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2096gitlab # [ 411.947156] sidekiq-cluster[3467]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname2097gitlab # [ 411.952044] sidekiq-cluster[3467]: FROM pg_type as t2098gitlab # [ 411.953797] sidekiq-cluster[3467]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')2099gitlab # [ 411.958321] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2100gitlab # [ 411.962030] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2101gitlab # [ 411.965214] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2102gitlab # [ 411.968613] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2103gitlab # [ 411.971620] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2104gitlab # [ 411.974651] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2105gitlab # [ 411.978179] sidekiq-cluster[3467]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2106gitlab # [ 411.981656] sidekiq-cluster[3467]: InitializerConnections Query: SET SESSION timezone TO 'UTC'2107gitlab # [ 411.984035] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2108gitlab # [ 411.986802] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2109gitlab # [ 411.989248] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2110gitlab # [ 411.991733] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2111gitlab # [ 411.993936] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2112gitlab # [ 411.996030] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2113gitlab # [ 411.998505] sidekiq-cluster[3467]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2114gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2115gitlab # [ 412.055686] sidekiq-cluster[3467]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'sidekiq_throttling_middleware'2116gitlab # [ 412.059021] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2117gitlab # [ 412.060475] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2118gitlab # [ 412.061682] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2119gitlab # [ 412.062996] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2120gitlab # [ 412.064185] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2121gitlab # [ 412.065355] sidekiq-cluster[3467]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2122gitlab # [ 412.066830] sidekiq-cluster[3467]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2123gitlab # [ 412.073815] nixbot[3533]: INFO: ::ffff:127.0.0.1:55346 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2124gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2125gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2126gitlab # [ 413.128225] nixbot[3533]: INFO: ::ffff:127.0.0.1:55348 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2127gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2128gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2129gitlab # [ 414.187130] nixbot[3533]: INFO: ::ffff:127.0.0.1:55358 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2130gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2131gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2132gitlab # [ 415.243411] nixbot[3533]: INFO: ::ffff:127.0.0.1:55364 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2133gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2134gitlab # [ 415.623280] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:39.465Z","message":"Booted Rails 7.2.3.1 application in production environment"}2135gitlab # [ 415.625962] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:39.468Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2136gitlab # [ 415.627882] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:39.468Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2137gitlab # [ 415.632550] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:39.468Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2138gitlab # [ 415.638854] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:39.473Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2139gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2140gitlab # [ 416.301890] nixbot[3533]: INFO: ::ffff:127.0.0.1:55380 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2141gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2142gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2143gitlab # [ 417.359323] nixbot[3533]: INFO: ::ffff:127.0.0.1:55396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2144gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2145gitlab # [ 418.257087] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:42.097Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"73f1581b36abc3d2e806be95","created_at":"2026-09-04T06:46:10.056Z","trace_propagation_headers":{"sentry-trace":"2b80e4b14f514e5da2487373de1afc26-9531fedcae6d4802","baggage":"sentry-trace_id=2b80e4b14f514e5da2487373de1afc26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNRGEPC5SW18VGMKQR618","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:10.120Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-73f1581b36abc3d2e806be95: start","job_status":"start","queue_duration_s":91.977309,"scheduling_latency_s":91.977414}2146gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2147gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2148gitlab # [ 418.417912] nixbot[3533]: INFO: ::ffff:127.0.0.1:55406 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2149gitlab # [ 418.653009] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:42.494Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"73f1581b36abc3d2e806be95","created_at":"2026-09-04T06:46:10.056Z","trace_propagation_headers":{"sentry-trace":"2b80e4b14f514e5da2487373de1afc26-9531fedcae6d4802","baggage":"sentry-trace_id=2b80e4b14f514e5da2487373de1afc26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNRGEPC5SW18VGMKQR618","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:10.120Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-73f1581b36abc3d2e806be95: done: 0.397303 sec","job_status":"done","queue_duration_s":91.977309,"scheduling_latency_s":91.977414,"redis_calls":23,"redis_duration_s":0.011889,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.006207,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003511,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002171,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.199557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20474248,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.397303,"completed_at":"2026-09-04T06:47:42.494Z","load_balancing_strategy":"primary","db_duration_s":0.114082,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2150gitlab # [ 418.752705] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:42.497Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e65c93f64bb518f64216afbe","created_at":"2026-09-04T06:46:10.138Z","trace_propagation_headers":{"sentry-trace":"2b80e4b14f514e5da2487373de1afc26-9531fedcae6d4802","baggage":"sentry-trace_id=2b80e4b14f514e5da2487373de1afc26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNRGEPC5SW18VGMKQR618","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:10.146Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e65c93f64bb518f64216afbe: start","job_status":"start","queue_duration_s":92.351057,"scheduling_latency_s":92.351096}2151gitlab # [ 418.833346] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:42.675Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e65c93f64bb518f64216afbe","created_at":"2026-09-04T06:46:10.138Z","trace_propagation_headers":{"sentry-trace":"2b80e4b14f514e5da2487373de1afc26-9531fedcae6d4802","baggage":"sentry-trace_id=2b80e4b14f514e5da2487373de1afc26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNRGEPC5SW18VGMKQR618","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:10.146Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e65c93f64bb518f64216afbe: done: 0.177786 sec","job_status":"done","queue_duration_s":92.351057,"scheduling_latency_s":92.351096,"redis_calls":14,"redis_duration_s":0.005262,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001079,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002626,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001557,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.130249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13608788,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.177786,"completed_at":"2026-09-04T06:47:42.675Z","load_balancing_strategy":"primary","db_duration_s":0.036217,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2152gitlab # [ 418.924214] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:42.677Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"eb192f0820eb8e5af09f78b8","created_at":"2026-09-04T06:46:11.008Z","trace_propagation_headers":{"sentry-trace":"2b80e4b14f514e5da2487373de1afc26-9531fedcae6d4802","baggage":"sentry-trace_id=2b80e4b14f514e5da2487373de1afc26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNRGEPC5SW18VGMKQR618","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:11.019Z","job_size_bytes":5,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-eb192f0820eb8e5af09f78b8: start","job_status":"start","queue_duration_s":91.657905,"scheduling_latency_s":91.657933}2153gitlab # [ 419.062355] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:42.904Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"eb192f0820eb8e5af09f78b8","created_at":"2026-09-04T06:46:11.008Z","trace_propagation_headers":{"sentry-trace":"2b80e4b14f514e5da2487373de1afc26-9531fedcae6d4802","baggage":"sentry-trace_id=2b80e4b14f514e5da2487373de1afc26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNRGEPC5SW18VGMKQR618","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:11.019Z","job_size_bytes":5,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-eb192f0820eb8e5af09f78b8: done: 0.226771 sec","job_status":"done","queue_duration_s":91.657905,"scheduling_latency_s":91.657933,"redis_calls":12,"redis_duration_s":0.0035960000000000002,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000903,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002109,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000584,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.178112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052516,"duration_s":0.226771,"completed_at":"2026-09-04T06:47:42.904Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041436,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2154gitlab # [ 419.159818] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:42.906Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"1ece032fb2025a1c53096a7a","created_at":"2026-09-04T06:46:11.083Z","trace_propagation_headers":{"sentry-trace":"2b80e4b14f514e5da2487373de1afc26-9531fedcae6d4802","baggage":"sentry-trace_id=2b80e4b14f514e5da2487373de1afc26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNRGEPC5SW18VGMKQR618","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:11.095Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-1ece032fb2025a1c53096a7a: start","job_status":"start","queue_duration_s":91.811219,"scheduling_latency_s":91.811241}2155gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2156gitlab # [ 419.328823] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:43.169Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"1ece032fb2025a1c53096a7a","created_at":"2026-09-04T06:46:11.083Z","trace_propagation_headers":{"sentry-trace":"2b80e4b14f514e5da2487373de1afc26-9531fedcae6d4802","baggage":"sentry-trace_id=2b80e4b14f514e5da2487373de1afc26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNRGEPC5SW18VGMKQR618","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:11.095Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-1ece032fb2025a1c53096a7a: done: 0.26345 sec","job_status":"done","queue_duration_s":91.811219,"scheduling_latency_s":91.811241,"redis_calls":11,"redis_duration_s":0.003081,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00074,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000574,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.221,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.221,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.164394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057018,"duration_s":0.26345,"completed_at":"2026-09-04T06:47:43.169Z","load_balancing_strategy":"primary","db_duration_s":0.101891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2157gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.05 seconds)2158gitlab # [ 419.436942] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:43.172Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"8b91f56851c998a43ecea1d0","created_at":"2026-09-04T06:46:11.103Z","trace_propagation_headers":{"sentry-trace":"2b80e4b14f514e5da2487373de1afc26-9531fedcae6d4802","baggage":"sentry-trace_id=2b80e4b14f514e5da2487373de1afc26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNRGEPC5SW18VGMKQR618","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:11.114Z","job_size_bytes":89,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-8b91f56851c998a43ecea1d0: start","job_status":"start","queue_duration_s":92.05806,"scheduling_latency_s":92.058086}2159gitlab # [ 419.480477] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:43.220Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"8b91f56851c998a43ecea1d0","created_at":"2026-09-04T06:46:11.103Z","trace_propagation_headers":{"sentry-trace":"2b80e4b14f514e5da2487373de1afc26-9531fedcae6d4802","baggage":"sentry-trace_id=2b80e4b14f514e5da2487373de1afc26,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNRGEPC5SW18VGMKQR618","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:11.114Z","job_size_bytes":89,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-8b91f56851c998a43ecea1d0: done: 0.048534 sec","job_status":"done","queue_duration_s":92.05806,"scheduling_latency_s":92.058086,"redis_calls":11,"redis_duration_s":0.0031,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000802,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054224,"duration_s":0.048534,"completed_at":"2026-09-04T06:47:43.220Z","load_balancing_strategy":"primary","db_duration_s":0.009065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2160gitlab # [ 419.552676] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:43.222Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d165fb1d17cc9646a68d65b0","created_at":"2026-09-04T06:46:13.548Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-e9d1d17201834106","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:46:13.558Z","job_size_bytes":185,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d165fb1d17cc9646a68d65b0: start","job_status":"start","queue_duration_s":89.664383,"scheduling_latency_s":89.664407}2161gitlab # [ 419.571873] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:43.243Z","message":"changes: \"0000000000000000000000000000000000000000 1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 refs/heads/master\\n\""}2162gitlab # [ 419.574895] nixbot[3533]: INFO: ::ffff:127.0.0.1:55408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2163gitlab # [ 419.577225] gitaly[908]: time="2026-09-04T06:47:43.311Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:47:53.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:43.296" grpc.time_ms=15.266 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 419.590567] gitaly[908]: time="2026-09-04T06:47:43.331Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:47:53.029" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:47:43.320" grpc.time_ms=10.945 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 419.604296] gitaly[908]: time="2026-09-04T06:47:43.421Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T06:47:53.112" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:43.402" grpc.time_ms=18.737 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 419.651387] gitaly[908]: time="2026-09-04T06:47:43.494Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:47:43.493" grpc.time_ms=0.745 pid=908 span.kind=server system=grpc2167gitlab # [ 419.705109] gitaly[908]: time="2026-09-04T06:47:43.547Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:47:43.546" grpc.time_ms=0.701 pid=908 span.kind=server system=grpc2168gitlab # [ 419.728349] gitaly[908]: time="2026-09-04T06:47:43.560Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX diskcache=c995a59b-e15e-400c-bfa1-834e16997e51 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:47:53.147" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:47:43.437" pid=908 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2169gitlab # [ 419.747633] gitaly[908]: time="2026-09-04T06:47:43.560Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=132 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5055 command.oublock=8 command.real_time_ms=115 command.spawn_token_fork_ms=1 command.system_time_ms=72 command.user_time_ms=60 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:47:53.147" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:47:43.437" grpc.time_ms=122.717 pid=908 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2170gitlab # [ 419.767388] gitaly[908]: time="2026-09-04T06:47:43.584Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T06:47:53.293" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:47:43.584" grpc.time_ms=0.303 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 419.781811] gitaly[908]: time="2026-09-04T06:47:43.616Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=859 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T06:47:53.003" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:43.594" grpc.time_ms=21.675 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 419.964852] gitaly[908]: time="2026-09-04T06:47:43.807Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-04T06:48:13.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:43.795" grpc.time_ms=12.264 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab # [ 420.028742] gitaly[908]: time="2026-09-04T06:47:43.871Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T06:47:53.280" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:47:43.870" grpc.time_ms=0.608 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2174gitlab # [ 420.060763] gitaly[908]: time="2026-09-04T06:47:43.886Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T06:47:53.285" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T06:47:43.875" grpc.time_ms=11.084 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 420.090460] gitaly[908]: time="2026-09-04T06:47:43.932Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:47:53.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:43.914" grpc.time_ms=17.72 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 420.117772] gitaly[908]: time="2026-09-04T06:47:43.960Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:47:53.032" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:43.943" grpc.time_ms=16.958 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 420.170240] gitaly[908]: time="2026-09-04T06:47:44.012Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T06:48:13.284" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:43.984" grpc.time_ms=27.919 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2179gitlab # [ 420.533839] nixbot[3533]: INFO: ::ffff:127.0.0.1:55422 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2180gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2181gitlab # [ 420.763819] gitaly[908]: time="2026-09-04T06:47:44.605Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T06:47:54.013" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:44.603" grpc.time_ms=1.497 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2182gitlab # [ 420.839783] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:44.680Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d165fb1d17cc9646a68d65b0","created_at":"2026-09-04T06:46:13.548Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-e9d1d17201834106","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:46:13.558Z","job_size_bytes":185,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d165fb1d17cc9646a68d65b0: done: 1.457638 sec","job_status":"done","queue_duration_s":89.664383,"scheduling_latency_s":89.664407,"gitaly_calls":13,"gitaly_duration_s":0.340995,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.066603,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.006937,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009347,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002017,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005288,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.025833,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.017181,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.092,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.324,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.382,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.092,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.962071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0010059,"exclusive_lock_hold_duration_s":0.05738142,"duration_s":1.457638,"completed_at":"2026-09-04T06:47:44.680Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.159424,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2183gitlab # [ 420.939101] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:44.683Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 b90a2947e4ec238146b91709b3d9a650dbfeedf8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"90638faf8d9058169703edec","created_at":"2026-09-04T06:46:20.736Z","trace_propagation_headers":{"sentry-trace":"926dc0f02bfe41759ad55f335b97015a-faa84323167e45ad","baggage":"sentry-trace_id=926dc0f02bfe41759ad55f335b97015a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:46:20.771Z","job_size_bytes":185,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-90638faf8d9058169703edec: start","job_status":"start","queue_duration_s":83.911724,"scheduling_latency_s":83.911766}2184gitlab # [ 420.958266] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:44.706Z","message":"changes: \"1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 b90a2947e4ec238146b91709b3d9a650dbfeedf8 refs/heads/master\\n\""}2185gitlab # [ 420.960748] gitaly[908]: time="2026-09-04T06:47:44.753Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:47:54.145" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:44.735" grpc.time_ms=17.674 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2186gitlab # [ 420.973600] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:44.787Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"e8431ce1d8b6700f6e1ae8fb","created_at":"2026-09-04T06:47:44.784Z","trace_propagation_headers":{"sentry-trace":"926dc0f02bfe41759ad55f335b97015a-4c88bd27fc1949b5","baggage":"sentry-trace_id=926dc0f02bfe41759ad55f335b97015a,sentry-release=Unknown"},"correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"10fe6f19bd944b812dc5e1f4","job_size_bytes":46,"pid":3467,"job_status":"deduplicated","message":"ProjectCacheWorker JID-e8431ce1d8b6700f6e1ae8fb: deduplicated: until executing","deduplication.type":"until executing"}2187gitlab # [ 420.987777] gitaly[908]: time="2026-09-04T06:47:44.779Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T06:47:54.172" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:47:44.762" grpc.time_ms=16.193 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188gitlab # [ 421.000960] gitaly[908]: time="2026-09-04T06:47:44.830Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T06:47:54.222" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:44.813" grpc.time_ms=17.634 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab # [ 421.016288] gitaly[908]: time="2026-09-04T06:47:44.858Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=598 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-04T06:48:14.139" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:44.839" grpc.time_ms=18.978 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2190gitlab # [ 421.059211] gitaly[908]: time="2026-09-04T06:47:44.890Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T06:47:54.288" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T06:47:44.879" grpc.time_ms=11.516 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2191gitlab # [ 421.084698] gitaly[908]: time="2026-09-04T06:47:44.927Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:47:54.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:44.909" grpc.time_ms=17.323 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2192gitlab # [ 421.260009] gitaly[908]: time="2026-09-04T06:47:45.102Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T06:47:55.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:45.100" grpc.time_ms=2.413 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 421.299081] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:45.140Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 b90a2947e4ec238146b91709b3d9a650dbfeedf8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"90638faf8d9058169703edec","created_at":"2026-09-04T06:46:20.736Z","trace_propagation_headers":{"sentry-trace":"926dc0f02bfe41759ad55f335b97015a-faa84323167e45ad","baggage":"sentry-trace_id=926dc0f02bfe41759ad55f335b97015a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:46:20.771Z","job_size_bytes":185,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-90638faf8d9058169703edec: done: 0.4571 sec","job_status":"done","queue_duration_s":83.911724,"scheduling_latency_s":83.911766,"gitaly_calls":7,"gitaly_duration_s":0.131843,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.034558,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.004015,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001511,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00416,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.012046,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.012826,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.042,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.042,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.283825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0011576,"exclusive_lock_hold_duration_s":0.03374858,"duration_s":0.4571,"completed_at":"2026-09-04T06:47:45.140Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043716,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2194gitlab # [ 421.383877] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:45.144Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"5c63038beb1cca2a3cde0545","created_at":"2026-09-04T06:46:21.597Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-c1425e6d7e364133","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:21.603Z","job_size_bytes":65,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-5c63038beb1cca2a3cde0545: start","job_status":"start","queue_duration_s":83.540755,"scheduling_latency_s":83.540797}2195gitlab # [ 421.446691] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:45.288Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"5c63038beb1cca2a3cde0545","created_at":"2026-09-04T06:46:21.597Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-c1425e6d7e364133","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:21.603Z","job_size_bytes":65,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-5c63038beb1cca2a3cde0545: done: 0.14381 sec","job_status":"done","queue_duration_s":83.540755,"scheduling_latency_s":83.540797,"redis_calls":16,"redis_duration_s":0.0060490000000000006,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003073,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002215,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068372,"duration_s":0.14381,"completed_at":"2026-09-04T06:47:45.288Z","load_balancing_strategy":"primary","db_duration_s":0.03637,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2196gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2197gitlab # [ 421.528121] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:45.291Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0832cd0a65da06803370c2e8","created_at":"2026-09-04T06:46:21.604Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-c1425e6d7e364133","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:21.610Z","job_size_bytes":65,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0832cd0a65da06803370c2e8: start","job_status":"start","queue_duration_s":83.680989,"scheduling_latency_s":83.681023}2198gitlab # [ 421.593482] nixbot[3533]: INFO: ::ffff:127.0.0.1:45956 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2199gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2200gitlab # [ 421.744347] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:45.586Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0832cd0a65da06803370c2e8","created_at":"2026-09-04T06:46:21.604Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-c1425e6d7e364133","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:21.610Z","job_size_bytes":65,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0832cd0a65da06803370c2e8: done: 0.295255 sec","job_status":"done","queue_duration_s":83.680989,"scheduling_latency_s":83.681023,"redis_calls":21,"redis_duration_s":0.006738,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003269,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001667,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.231621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048752,"duration_s":0.295255,"completed_at":"2026-09-04T06:47:45.586Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052804,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2201gitlab # [ 421.842137] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:45.589Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"56512178456bd20058a67578","created_at":"2026-09-04T06:46:21.783Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-c1425e6d7e364133","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:21.798Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-56512178456bd20058a67578: start","job_status":"start","queue_duration_s":83.79041,"scheduling_latency_s":83.790435}2202gitlab # [ 421.977959] gitaly[908]: time="2026-09-04T06:47:45.819Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:47:45.818" grpc.time_ms=0.908 pid=908 span.kind=server system=grpc2203gitlab # [ 422.030582] gitaly[908]: time="2026-09-04T06:47:45.873Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:47:45.870" grpc.time_ms=2.419 pid=908 span.kind=server system=grpc2204gitlab # [ 422.083744] gitaly[908]: time="2026-09-04T06:47:45.926Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:47:45.925" grpc.time_ms=0.726 pid=908 span.kind=server system=grpc2205gitlab # [ 422.112602] gitaly[908]: time="2026-09-04T06:47:45.939Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y diskcache=ab534ab6-d3b6-43ad-9363-c2179f723e58 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:48:15.064" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:45.765" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206gitlab # [ 422.133147] gitaly[908]: time="2026-09-04T06:47:45.939Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=199 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7549 command.oublock=0 command.real_time_ms=167 command.spawn_token_fork_ms=1 command.system_time_ms=117 command.user_time_ms=82 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:48:15.064" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:45.765" grpc.time_ms=174.228 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2207gitlab # [ 422.297232] gitaly[908]: time="2026-09-04T06:47:46.139Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:48:16.037" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:46.137" grpc.time_ms=1.704 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2208gitlab # [ 422.356653] gitaly[908]: time="2026-09-04T06:47:46.199Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP5RPFVB1H1WK72X14C1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:16.097" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:46.197" grpc.time_ms=1.42 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2209gitlab # [ 422.399576] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:46.241Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"56512178456bd20058a67578","created_at":"2026-09-04T06:46:21.783Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-c1425e6d7e364133","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:46:21.798Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-56512178456bd20058a67578: done: 0.651936 sec","job_status":"done","queue_duration_s":83.79041,"scheduling_latency_s":83.790435,"gitaly_calls":3,"gitaly_duration_s":0.188451,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.038801,"redis_read_bytes":457,"redis_write_bytes":28000,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002096,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001668,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.012531,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.007012,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14494,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.007881,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000812,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000875,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00383,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.091,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.031,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.035,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.047,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.342119,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.56299772,"duration_s":0.651936,"completed_at":"2026-09-04T06:47:46.241Z","load_balancing_strategy":"primary","db_duration_s":0.106516,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2210gitlab # [ 422.470950] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:46.244Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"10fe6f19bd944b812dc5e1f4","created_at":"2026-09-04T06:47:43.335Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-5e525fa675174de5","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:43.361Z","job_size_bytes":46,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-10fe6f19bd944b812dc5e1f4: start","job_status":"start","queue_duration_s":2.882337,"scheduling_latency_s":2.882376}2211gitlab # [ 422.494608] gitaly[908]: time="2026-09-04T06:47:46.337Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-04T12:47:46.326" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:47:46.327" grpc.time_ms=9.431 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2212gitlab # [ 422.525188] gitaly[908]: time="2026-09-04T06:47:46.363Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T06:48:16.249" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:46.349" grpc.time_ms=13.505 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2214gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2215gitlab # [ 422.568799] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:46.410Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"10fe6f19bd944b812dc5e1f4","created_at":"2026-09-04T06:47:43.335Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-5e525fa675174de5","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:43.361Z","job_size_bytes":46,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-10fe6f19bd944b812dc5e1f4: done: 0.166515 sec","job_status":"done","queue_duration_s":2.882337,"scheduling_latency_s":2.882376,"gitaly_calls":2,"gitaly_duration_s":0.029699,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.009715,"redis_read_bytes":69,"redis_write_bytes":4881,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001796,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000857,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002268,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003769,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048858,"duration_s":0.166515,"completed_at":"2026-09-04T06:47:46.410Z","load_balancing_strategy":"primary","db_duration_s":0.018177,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2216gitlab # [ 422.665401] gitaly[908]: time="2026-09-04T06:47:46.487Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX diskcache=bffbcd5b-3396-4cef-81b7-031e38e06cb6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T12:47:46.445" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:46.446" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2217gitlab # [ 422.681534] nixbot[3533]: INFO: ::ffff:127.0.0.1:45958 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2218gitlab # [ 422.684745] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:46.413Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e41f15e3f9b7503a595f4306","created_at":"2026-09-04T06:47:43.388Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-5e525fa675174de5","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:43.396Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e41f15e3f9b7503a595f4306: start","job_status":"start","queue_duration_s":3.016325,"scheduling_latency_s":3.016352}2219gitlab # [ 422.707437] gitaly[908]: time="2026-09-04T06:47:46.488Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=48 command.spawn_token_fork_ms=4 command.system_time_ms=27 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T12:47:46.445" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:46.446" grpc.time_ms=41.188 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2220gitlab # [ 422.729876] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:46.571Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e41f15e3f9b7503a595f4306","created_at":"2026-09-04T06:47:43.388Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-5e525fa675174de5","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:43.396Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e41f15e3f9b7503a595f4306: done: 0.158694 sec","job_status":"done","queue_duration_s":3.016325,"scheduling_latency_s":3.016352,"gitaly_calls":1,"gitaly_duration_s":0.044573,"redis_calls":15,"redis_duration_s":0.005039,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000544,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002017,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000803,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001675,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.021,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.041,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11885054,"duration_s":0.158694,"completed_at":"2026-09-04T06:47:46.571Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2221gitlab # [ 422.780689] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:46.575Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"7950e647dea1102a1a9f90c0","created_at":"2026-09-04T06:47:43.577Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-5e525fa675174de5","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:43.580Z","job_size_bytes":23,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-7950e647dea1102a1a9f90c0: start","job_status":"start","queue_duration_s":2.995234,"scheduling_latency_s":2.995272}2222gitlab # [ 422.799717] gitaly[908]: time="2026-09-04T06:47:46.642Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T06:48:16.524" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:46.624" grpc.time_ms=17.356 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2223gitlab # [ 422.837086] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:46.652Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"7950e647dea1102a1a9f90c0","created_at":"2026-09-04T06:47:43.577Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-5e525fa675174de5","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:43.580Z","job_size_bytes":23,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-7950e647dea1102a1a9f90c0: done: 0.07708 sec","job_status":"done","queue_duration_s":2.995234,"scheduling_latency_s":2.995272,"gitaly_calls":1,"gitaly_duration_s":0.020529,"redis_calls":16,"redis_duration_s":0.005131,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000329,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001502,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002328,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.07708,"completed_at":"2026-09-04T06:47:46.652Z","load_balancing_strategy":"primary","db_duration_s":0.004792,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2224gitlab # [ 422.905148] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:46.654Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8c4384f699ed15759f777b70","created_at":"2026-09-04T06:47:44.412Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-5e525fa675174de5","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:33583607a544ba51537a08344531d9cbf65bf49d5d7817bc66a12421a07ec224","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:44.419Z","job_size_bytes":467,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8c4384f699ed15759f777b70: start","job_status":"start","queue_duration_s":2.234574,"scheduling_latency_s":2.234595}2225gitlab # [ 422.924087] gitaly[908]: time="2026-09-04T06:47:46.685Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:16.583" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:46.683" grpc.time_ms=1.082 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2226gitlab # [ 422.936936] gitaly[908]: time="2026-09-04T06:47:46.704Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T06:47:56.007" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:46.687" grpc.time_ms=16.29 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2227gitlab # [ 422.993666] gitaly[908]: time="2026-09-04T06:47:46.835Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:48:16.733" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:46.833" grpc.time_ms=1.288 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2228gitlab # [ 423.031665] gitaly[908]: time="2026-09-04T06:47:46.844Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=104 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T06:48:16.738" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:46.839" grpc.time_ms=4.912 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2229gitlab # [ 423.106633] gitaly[908]: time="2026-09-04T06:47:46.949Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:47:56.252" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:46.932" grpc.time_ms=16.501 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2230gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2231gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.07 seconds)2232gitlab # [ 423.719551] nixbot[3533]: INFO: ::ffff:127.0.0.1:45966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2233gitlab # [ 423.877005] gitaly[908]: time="2026-09-04T06:47:47.719Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=9 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T06:48:17.592" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:47.692" grpc.time_ms=26.536 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2234gitlab # [ 423.920585] gitaly[908]: time="2026-09-04T06:47:47.745Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJNXCHZM0GTABD166NVMSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T06:48:17.623" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:47.723" grpc.time_ms=21.788 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2235gitlab # [ 423.947218] sidekiq-cluster[3467]: {"severity":"WARN","time":"2026-09-04T06:47:47.786Z","class":"CreatePipelineWorker","correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"1aa3a2d12d76c3cca7bf3f3b68b38d589885a229","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"1aa3a2d12d76c3cca7bf3f3b68b38d589885a229","ref":"refs/heads/master"},"retry":0}2236gitlab # [ 423.958395] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:47.796Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8c4384f699ed15759f777b70","created_at":"2026-09-04T06:47:44.412Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-5e525fa675174de5","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:33583607a544ba51537a08344531d9cbf65bf49d5d7817bc66a12421a07ec224","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:44.419Z","job_size_bytes":467,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8c4384f699ed15759f777b70: done: 1.142497 sec","job_status":"done","queue_duration_s":2.234574,"scheduling_latency_s":2.234595,"gitaly_calls":7,"gitaly_duration_s":0.107819,"redis_calls":51,"redis_duration_s":0.0124,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001174,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005206,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0016,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003221,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.956215,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041928,"duration_s":1.142497,"completed_at":"2026-09-04T06:47:47.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.078962,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2237gitlab # [ 424.032978] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:47.799Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"80b52879-7e58-44c0-bede-1a0fda69f317\"}"],"class":"WebHookWorker","jid":"8259c437e0aa96f36bfccdc8","created_at":"2026-09-04T06:47:44.566Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-5e525fa675174de5","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:40a322c49388f4b55a8692f9286191270a2938a75c5ae5d4201a8ade605d134b","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:44.572Z","job_size_bytes":1751,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-8259c437e0aa96f36bfccdc8: start","job_status":"start","queue_duration_s":3.226535,"scheduling_latency_s":3.226562}2238gitlab # [ 424.144899] nixbot[3533]: INFO: ::ffff:127.0.0.1:45982 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2239gitlab # [ 424.190090] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:48.031Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"80b52879-7e58-44c0-bede-1a0fda69f317\"}"],"class":"WebHookWorker","jid":"8259c437e0aa96f36bfccdc8","created_at":"2026-09-04T06:47:44.566Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-5e525fa675174de5","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:40a322c49388f4b55a8692f9286191270a2938a75c5ae5d4201a8ade605d134b","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:44.572Z","job_size_bytes":1751,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-8259c437e0aa96f36bfccdc8: done: 0.232171 sec","job_status":"done","queue_duration_s":3.226535,"scheduling_latency_s":3.226562,"redis_calls":19,"redis_duration_s":0.006889,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00167,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000905,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002852,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001462,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09302619999999706,"cpu_s":0.116571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007708,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.232171,"completed_at":"2026-09-04T06:47:48.031Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2240gitlab # [ 424.288522] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:48.036Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b1a3c57b4ac82dd9047ea5bf","created_at":"2026-09-04T06:47:44.799Z","trace_propagation_headers":{"sentry-trace":"926dc0f02bfe41759ad55f335b97015a-4c88bd27fc1949b5","baggage":"sentry-trace_id=926dc0f02bfe41759ad55f335b97015a,sentry-release=Unknown"},"correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e41f15e3f9b7503a595f4306","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:44.805Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b1a3c57b4ac82dd9047ea5bf: start","job_status":"start","queue_duration_s":3.231517,"scheduling_latency_s":3.231569}2241gitlab # [ 424.312819] gitaly[908]: time="2026-09-04T06:47:48.102Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM diskcache=b7bc26b7-905b-4fa9-8645-ab29b996022c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T12:47:48.087" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:48.088" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2242gitlab # [ 424.324575] gitaly[908]: time="2026-09-04T06:47:48.103Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T12:47:48.087" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:48.088" grpc.time_ms=13.971 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2243gitlab # [ 424.338617] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:48.144Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b1a3c57b4ac82dd9047ea5bf","created_at":"2026-09-04T06:47:44.799Z","trace_propagation_headers":{"sentry-trace":"926dc0f02bfe41759ad55f335b97015a-4c88bd27fc1949b5","baggage":"sentry-trace_id=926dc0f02bfe41759ad55f335b97015a,sentry-release=Unknown"},"correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e41f15e3f9b7503a595f4306","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:44.805Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b1a3c57b4ac82dd9047ea5bf: done: 0.107771 sec","job_status":"done","queue_duration_s":3.231517,"scheduling_latency_s":3.231569,"gitaly_calls":1,"gitaly_duration_s":0.01873,"redis_calls":12,"redis_duration_s":0.008059,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00426,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000945,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002854,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05687108,"duration_s":0.107771,"completed_at":"2026-09-04T06:47:48.144Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2244gitlab # [ 424.383968] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:48.147Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"2720b3675072b391ab053740","created_at":"2026-09-04T06:47:45.027Z","trace_propagation_headers":{"sentry-trace":"926dc0f02bfe41759ad55f335b97015a-4c88bd27fc1949b5","baggage":"sentry-trace_id=926dc0f02bfe41759ad55f335b97015a,sentry-release=Unknown"},"correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:afca39f3489e2862dd35692cf75d4445cbbec9c3b5e7ed8381eadbc7046e840f","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:45.032Z","job_size_bytes":467,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-2720b3675072b391ab053740: start","job_status":"start","queue_duration_s":3.114778,"scheduling_latency_s":3.114814}2245gitlab # [ 424.400744] gitaly[908]: time="2026-09-04T06:47:48.192Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:18.090" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:48.191" grpc.time_ms=0.867 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2246gitlab # [ 424.413276] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1912247gitlab # [ 424.415331] gitaly[908]: time="2026-09-04T06:47:48.207Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T06:47:58.105" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:48.195" grpc.time_ms=11.733 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2248gitlab # [ 424.428174] gitaly[908]: time="2026-09-04T06:47:48.229Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NJRTJ66R9VA9E2421APC6Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:48.215" grpc.time_ms=13.346 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc2249gitlab # [ 424.441889] gitaly[908]: time="2026-09-04T06:47:48.284Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:48:18.182" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:48.283" grpc.time_ms=1.165 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2250gitlab # [ 424.457309] gitaly[908]: time="2026-09-04T06:47:48.299Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=238 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T06:48:18.192" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:48.292" grpc.time_ms=6.991 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2251gitlab # [ 424.500662] gitaly[908]: time="2026-09-04T06:47:48.343Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:47:58.243" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:48.333" grpc.time_ms=9.835 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2252gitlab # [ 424.526320] gitaly[908]: time="2026-09-04T06:47:48.343Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRTR8JVW4S6N0APM8S3HN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:48.324" pid=908 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2253gitlab # [ 424.544114] gitlab-workhorse[826]: time="2026-09-04T06:47:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672254gitlab # [ 424.546926] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1112255gitlab # [ 424.550228] gitaly[908]: time="2026-09-04T06:47:48.343Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRTR8JVW4S6N0APM8S3HN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:48.324" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc2256gitlab # [ 424.568316] nixbot[3533]: {"ts": "2026-09-04T06:47:48.389Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2257gitlab # [ 424.571306] gitaly[908]: time="2026-09-04T06:47:48.343Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRTR8JVW4S6N0APM8S3HN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:48.324" grpc.time_ms=19.663 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc2258gitlab # [ 424.641815] gitaly[908]: time="2026-09-04T06:47:48.484Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRTXNS575SVETF8HN66SE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:18.482" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:48.483" grpc.time_ms=1.011 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2260gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.06 seconds)2261gitlab # [ 424.757709] gitaly[908]: time="2026-09-04T06:47:48.599Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NJRTXNS575SVETF8HN66SE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:47:58.230" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:48.580" grpc.time_ms=19.253 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2262gitlab # [ 424.796900] nixbot[3533]: INFO: ::ffff:127.0.0.1:45986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2263gitlab # [ 424.859479] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2952264gitlab # [ 424.867558] nixbot[3533]: {"ts": "2026-09-04T06:47:48.703Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 \"HTTP/1.1 201 Created\""}2265gitlab # [ 424.935769] gitaly[908]: time="2026-09-04T06:47:48.778Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRV74K8D60WVZ5Z14WNZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:18.776" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:48.776" grpc.time_ms=1.342 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2266gitlab # [ 425.005374] gitaly[908]: time="2026-09-04T06:47:48.848Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJRV74K8D60WVZ5Z14WNZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:47:58.246" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:48.836" grpc.time_ms=10.922 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2267gitlab # [ 425.094000] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2272268gitlab # [ 425.101444] nixbot[3533]: {"ts": "2026-09-04T06:47:48.938Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 \"HTTP/1.1 201 Created\""}2269gitlab # [ 425.174954] gitaly[908]: time="2026-09-04T06:47:49.017Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRVEM815SEPSCVHDCAE7N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:19.015" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:49.016" grpc.time_ms=1.105 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2270gitlab # [ 425.253035] gitaly[908]: time="2026-09-04T06:47:49.095Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T06:48:19.077" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:49.078" grpc.time_ms=17.433 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2271gitlab # [ 425.277077] gitaly[908]: time="2026-09-04T06:47:49.111Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJRVEM815SEPSCVHDCAE7N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:47:59.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:49.091" grpc.time_ms=20.017 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2272gitlab # [ 425.293955] gitaly[908]: time="2026-09-04T06:47:49.126Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJP4KG24Y2HZ8TTKJ5F6CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T06:48:19.001" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:49.101" grpc.time_ms=24.16 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2273gitlab # [ 425.309131] sidekiq-cluster[3467]: {"severity":"WARN","time":"2026-09-04T06:47:49.145Z","class":"CreatePipelineWorker","correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"1aa3a2d12d76c3cca7bf3f3b68b38d589885a229","after":"b90a2947e4ec238146b91709b3d9a650dbfeedf8","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"b90a2947e4ec238146b91709b3d9a650dbfeedf8","ref":"refs/heads/master"},"retry":0}2274gitlab # [ 425.316466] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.153Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"2720b3675072b391ab053740","created_at":"2026-09-04T06:47:45.027Z","trace_propagation_headers":{"sentry-trace":"926dc0f02bfe41759ad55f335b97015a-4c88bd27fc1949b5","baggage":"sentry-trace_id=926dc0f02bfe41759ad55f335b97015a,sentry-release=Unknown"},"correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:afca39f3489e2862dd35692cf75d4445cbbec9c3b5e7ed8381eadbc7046e840f","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:45.032Z","job_size_bytes":467,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-2720b3675072b391ab053740: done: 1.006136 sec","job_status":"done","queue_duration_s":3.114778,"scheduling_latency_s":3.114814,"gitaly_calls":7,"gitaly_duration_s":0.101392,"redis_calls":33,"redis_duration_s":0.012608000000000001,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001767,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003334,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.005048,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002459,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.864099,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.006136,"completed_at":"2026-09-04T06:47:49.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040801,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2275gitlab # [ 425.363647] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.155Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"08806b6f-d1c6-48c7-b579-fe1938357a47\"}"],"class":"WebHookWorker","jid":"fceacb5fdc4a4760ef133a00","created_at":"2026-09-04T06:47:45.065Z","trace_propagation_headers":{"sentry-trace":"926dc0f02bfe41759ad55f335b97015a-4c88bd27fc1949b5","baggage":"sentry-trace_id=926dc0f02bfe41759ad55f335b97015a,sentry-release=Unknown"},"correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2bdd85009855fb5b7d437a3a789ebb9f87d2c7877ef05fc20060760aaf95dae2","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:45.071Z","job_size_bytes":1749,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-fceacb5fdc4a4760ef133a00: start","job_status":"start","queue_duration_s":4.084722,"scheduling_latency_s":4.084753}2276gitlab # [ 425.381115] nixbot[3533]: INFO: ::ffff:127.0.0.1:45992 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2277gitlab # [ 425.382320] nixbot[3533]: {"ts": "2026-09-04T06:47:49.205Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 \"HTTP/1.1 201 Created\""}2278gitlab # [ 425.385041] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1aa3a2d12d76c3cca7bf3f3b68b38d589885a229 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2532279gitlab # [ 425.387436] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.213Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"08806b6f-d1c6-48c7-b579-fe1938357a47\"}"],"class":"WebHookWorker","jid":"fceacb5fdc4a4760ef133a00","created_at":"2026-09-04T06:47:45.065Z","trace_propagation_headers":{"sentry-trace":"926dc0f02bfe41759ad55f335b97015a-4c88bd27fc1949b5","baggage":"sentry-trace_id=926dc0f02bfe41759ad55f335b97015a,sentry-release=Unknown"},"correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2bdd85009855fb5b7d437a3a789ebb9f87d2c7877ef05fc20060760aaf95dae2","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:45.071Z","job_size_bytes":1749,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-fceacb5fdc4a4760ef133a00: done: 0.058065 sec","job_status":"done","queue_duration_s":4.084722,"scheduling_latency_s":4.084753,"redis_calls":14,"redis_duration_s":0.005253,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.001007,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003121,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001125,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.011049759999991693,"cpu_s":0.031748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.058065,"completed_at":"2026-09-04T06:47:49.213Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2280gitlab # [ 425.435248] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.221Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b237e00a7cafc0a988be6d1a","created_at":"2026-09-04T06:47:45.743Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:45.750Z","job_size_bytes":23,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b237e00a7cafc0a988be6d1a: start","job_status":"start","queue_duration_s":3.470948,"scheduling_latency_s":3.470977}2281gitlab # [ 425.538958] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.380Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b237e00a7cafc0a988be6d1a","created_at":"2026-09-04T06:47:45.743Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:45.750Z","job_size_bytes":23,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b237e00a7cafc0a988be6d1a: done: 0.159912 sec","job_status":"done","queue_duration_s":3.470948,"scheduling_latency_s":3.470977,"redis_calls":10,"redis_duration_s":0.003112,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000664,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001808,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00064,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006039,"duration_s":0.159912,"completed_at":"2026-09-04T06:47:49.380Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036002,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2282gitlab # [ 425.620692] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.383Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1d785eafdb28d455c78f94b8","created_at":"2026-09-04T06:47:45.949Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:45.960Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1d785eafdb28d455c78f94b8: start","job_status":"start","queue_duration_s":3.422855,"scheduling_latency_s":3.422886}2283gitlab # [ 425.641844] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.441Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1d785eafdb28d455c78f94b8","created_at":"2026-09-04T06:47:45.949Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:45.960Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1d785eafdb28d455c78f94b8: done: 0.058026 sec","job_status":"done","queue_duration_s":3.422855,"scheduling_latency_s":3.422886,"redis_calls":10,"redis_duration_s":0.0023279999999999998,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000477,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000553,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003417,"duration_s":0.058026,"completed_at":"2026-09-04T06:47:49.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2284gitlab # [ 425.690995] gitaly[908]: time="2026-09-04T06:47:49.516Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJRVR29NB2VV2J5JWT0MYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:49.506" grpc.time_ms=10.412 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc2285gitlab # [ 425.704511] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2672286gitlab # [ 425.706549] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.443Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1aad111605aaa842cdaf9963","created_at":"2026-09-04T06:47:45.991Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.002Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1aad111605aaa842cdaf9963: start","job_status":"start","queue_duration_s":3.44092,"scheduling_latency_s":3.440944}2287gitlab # [ 425.722261] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1aad111605aaa842cdaf9963","created_at":"2026-09-04T06:47:45.991Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.002Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1aad111605aaa842cdaf9963: done: 0.046225 sec","job_status":"done","queue_duration_s":3.44092,"scheduling_latency_s":3.440944,"redis_calls":10,"redis_duration_s":0.002827,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000368,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001936,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050502,"duration_s":0.046225,"completed_at":"2026-09-04T06:47:49.489Z","load_balancing_strategy":"primary","db_duration_s":0.005934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 425.764720] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.491Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"12c1e1414c8df9e5d3e13ddd","created_at":"2026-09-04T06:47:46.030Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.039Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-12c1e1414c8df9e5d3e13ddd: start","job_status":"start","queue_duration_s":3.451707,"scheduling_latency_s":3.451727}2289gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2290gitlab # [ 425.779937] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.539Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"12c1e1414c8df9e5d3e13ddd","created_at":"2026-09-04T06:47:46.030Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.039Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-12c1e1414c8df9e5d3e13ddd: done: 0.04797 sec","job_status":"done","queue_duration_s":3.451707,"scheduling_latency_s":3.451727,"redis_calls":13,"redis_duration_s":0.003309,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000385,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002631,"duration_s":0.04797,"completed_at":"2026-09-04T06:47:49.539Z","load_balancing_strategy":"primary","db_duration_s":0.008739,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2291gitlab # [ 425.825940] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.540Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"441abd8112dc776f0f6371af","created_at":"2026-09-04T06:47:46.040Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.048Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-441abd8112dc776f0f6371af: start","job_status":"start","queue_duration_s":3.491706,"scheduling_latency_s":3.491724}2292gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.08 seconds)2293gitlab # [ 425.842488] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.574Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"441abd8112dc776f0f6371af","created_at":"2026-09-04T06:47:46.040Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.048Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-441abd8112dc776f0f6371af: done: 0.034135 sec","job_status":"done","queue_duration_s":3.491706,"scheduling_latency_s":3.491724,"redis_calls":10,"redis_duration_s":0.0016719999999999999,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000343,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000985,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000344,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026044,"duration_s":0.034135,"completed_at":"2026-09-04T06:47:49.574Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004509,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2294gitlab # [ 425.886913] gitlab-workhorse[826]: time="2026-09-04T06:47:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672295gitlab # [ 425.888875] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1052296gitlab # [ 425.890738] gitaly[908]: time="2026-09-04T06:47:49.625Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRW0HRZK096ZMG7JSBRXB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:49.613" pid=908 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2297gitlab # [ 425.900959] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.576Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"279f21b121440b44a487b21c","created_at":"2026-09-04T06:47:46.049Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.060Z","job_size_bytes":19,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-279f21b121440b44a487b21c: start","job_status":"start","queue_duration_s":3.515354,"scheduling_latency_s":3.51537}2298gitlab # [ 425.916658] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.610Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"279f21b121440b44a487b21c","created_at":"2026-09-04T06:47:46.049Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.060Z","job_size_bytes":19,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-279f21b121440b44a487b21c: done: 0.034625 sec","job_status":"done","queue_duration_s":3.515354,"scheduling_latency_s":3.51537,"redis_calls":11,"redis_duration_s":0.002393,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000398,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001604,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003036,"duration_s":0.034625,"completed_at":"2026-09-04T06:47:49.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2299gitlab # [ 425.960762] nixbot[3533]: INFO: ::ffff:127.0.0.1:45996 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2300gitlab # [ 425.962687] gitaly[908]: time="2026-09-04T06:47:49.625Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRW0HRZK096ZMG7JSBRXB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:49.613" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc2301gitlab # [ 425.976157] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.612Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"58ed0187346c003e8f31ba53","created_at":"2026-09-04T06:47:46.065Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.072Z","job_size_bytes":66,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-58ed0187346c003e8f31ba53: start","job_status":"start","queue_duration_s":3.539581,"scheduling_latency_s":3.539599}2302gitlab # [ 425.993167] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.649Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"58ed0187346c003e8f31ba53","created_at":"2026-09-04T06:47:46.065Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.072Z","job_size_bytes":66,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-58ed0187346c003e8f31ba53: done: 0.03692 sec","job_status":"done","queue_duration_s":3.539581,"scheduling_latency_s":3.539599,"redis_calls":10,"redis_duration_s":0.002809,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0005,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040638,"duration_s":0.03692,"completed_at":"2026-09-04T06:47:49.649Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2303gitlab # [ 426.039107] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 762304gitlab # [ 426.041250] gitlab-workhorse[826]: time="2026-09-04T06:47:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672305gitlab # [ 426.043039] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 722306gitlab # [ 426.044969] gitaly[908]: time="2026-09-04T06:47:49.626Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRW0HRZK096ZMG7JSBRXB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:49.613" grpc.time_ms=12.556 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc2307gitlab # [ 426.059345] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"ba137cc4aa1023086cb06482","created_at":"2026-09-04T06:47:46.074Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.080Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ba137cc4aa1023086cb06482: start","job_status":"start","queue_duration_s":3.57135,"scheduling_latency_s":3.57137}2308gitlab # [ 426.075392] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.732Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"ba137cc4aa1023086cb06482","created_at":"2026-09-04T06:47:46.074Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.080Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ba137cc4aa1023086cb06482: done: 0.081156 sec","job_status":"done","queue_duration_s":3.57135,"scheduling_latency_s":3.57137,"redis_calls":10,"redis_duration_s":0.003658,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000637,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002523,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029664,"duration_s":0.081156,"completed_at":"2026-09-04T06:47:49.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029836,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2309gitlab # [ 426.119160] gitaly[908]: time="2026-09-04T06:47:49.748Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJRW588PFTET4761FBTN5W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:49.738" grpc.time_ms=9.204 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc2310gitlab # [ 426.132206] gitaly[908]: time="2026-09-04T06:47:49.821Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRW7N3QHX2CVYVTGX1WAM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:49.809" pid=908 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2311gitlab # [ 426.142066] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.734Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5430bf0889912148ddcfd4ca","created_at":"2026-09-04T06:47:46.091Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.096Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5430bf0889912148ddcfd4ca: start","job_status":"start","queue_duration_s":3.637977,"scheduling_latency_s":3.637997}2312gitlab # [ 426.158436] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.773Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5430bf0889912148ddcfd4ca","created_at":"2026-09-04T06:47:46.091Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.096Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5430bf0889912148ddcfd4ca: done: 0.038979 sec","job_status":"done","queue_duration_s":3.637977,"scheduling_latency_s":3.637997,"redis_calls":10,"redis_duration_s":0.001931,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000353,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026968,"duration_s":0.038979,"completed_at":"2026-09-04T06:47:49.773Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2313gitlab # [ 426.202213] gitaly[908]: time="2026-09-04T06:47:49.821Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRW7N3QHX2CVYVTGX1WAM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:49.809" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc2314gitlab # [ 426.215884] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.775Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"3e2dc2813fb48ba5bbb5a099","created_at":"2026-09-04T06:47:46.097Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.102Z","job_size_bytes":6,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-3e2dc2813fb48ba5bbb5a099: start","job_status":"start","queue_duration_s":3.673119,"scheduling_latency_s":3.673139}2315gitlab # [ 426.232808] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.801Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"3e2dc2813fb48ba5bbb5a099","created_at":"2026-09-04T06:47:46.097Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.102Z","job_size_bytes":6,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-3e2dc2813fb48ba5bbb5a099: done: 0.025503 sec","job_status":"done","queue_duration_s":3.673119,"scheduling_latency_s":3.673139,"redis_calls":10,"redis_duration_s":0.0026449999999999998,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000304,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000433,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00078974,"duration_s":0.025503,"completed_at":"2026-09-04T06:47:49.801Z","load_balancing_strategy":"primary","db_duration_s":0.002357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2316gitlab # [ 426.276607] gitaly[908]: time="2026-09-04T06:47:49.822Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRW7N3QHX2CVYVTGX1WAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T06:47:49.809" grpc.time_ms=12.422 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc2317gitlab # [ 426.290619] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.803Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"4c1c8725de78c0d1785dfc5c","created_at":"2026-09-04T06:47:46.103Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.109Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-4c1c8725de78c0d1785dfc5c: start","job_status":"start","queue_duration_s":3.694079,"scheduling_latency_s":3.694096}2318gitlab # [ 426.305916] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.854Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"4c1c8725de78c0d1785dfc5c","created_at":"2026-09-04T06:47:46.103Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.109Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-4c1c8725de78c0d1785dfc5c: done: 0.05104 sec","job_status":"done","queue_duration_s":3.694079,"scheduling_latency_s":3.694096,"redis_calls":10,"redis_duration_s":0.00284,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000306,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002039,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000495,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067508,"duration_s":0.05104,"completed_at":"2026-09-04T06:47:49.854Z","load_balancing_strategy":"primary","db_duration_s":0.018211,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 426.348359] gitaly[908]: time="2026-09-04T06:47:49.944Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:19.042" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:49.943" grpc.time_ms=1.03 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2320gitlab # [ 426.361376] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.858Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"dfe6214875023fd46d27f8b2","created_at":"2026-09-04T06:47:46.116Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.121Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-dfe6214875023fd46d27f8b2: start","job_status":"start","queue_duration_s":3.736767,"scheduling_latency_s":3.736786}2321gitlab # [ 426.377342] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.932Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"dfe6214875023fd46d27f8b2","created_at":"2026-09-04T06:47:46.116Z","trace_propagation_headers":{"sentry-trace":"7a290c5d262b41dc9be0cdcda02331f4-95ca949f2752405f","baggage":"sentry-trace_id=7a290c5d262b41dc9be0cdcda02331f4,sentry-release=Unknown"},"correlation_id":"01M1NJP5RPFVB1H1WK72X14C1Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.121Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-dfe6214875023fd46d27f8b2: done: 0.073587 sec","job_status":"done","queue_duration_s":3.736767,"scheduling_latency_s":3.736786,"redis_calls":14,"redis_duration_s":0.006127,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00033,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004225,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001572,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069082,"duration_s":0.073587,"completed_at":"2026-09-04T06:47:49.932Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2322gitlab # [ 426.421339] gitaly[908]: time="2026-09-04T06:47:49.967Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T06:48:19.057" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:49.958" grpc.time_ms=9.13 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2323gitlab # [ 426.437019] nixbot[3533]: {"ts": "2026-09-04T06:47:50.218Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b90a2947e4ec238146b91709b3d9a650dbfeedf8 \"HTTP/1.1 201 Created\""}2324gitlab # [ 426.439710] nixbot[3533]: {"ts": "2026-09-04T06:47:50.228Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-b90a2947e4ec-5"}2325gitlab # [ 426.442135] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.934Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"d4293e3d963c86c349740b07","created_at":"2026-09-04T06:47:46.380Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-1f964600f828429b","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.388Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-d4293e3d963c86c349740b07: start","job_status":"start","queue_duration_s":3.545072,"scheduling_latency_s":3.545089}2326gitlab # [ 426.458248] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:49.999Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"d4293e3d963c86c349740b07","created_at":"2026-09-04T06:47:46.380Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-1f964600f828429b","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:46.388Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-d4293e3d963c86c349740b07: done: 0.06525 sec","job_status":"done","queue_duration_s":3.545072,"scheduling_latency_s":3.545089,"redis_calls":19,"redis_duration_s":0.005196,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001185,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000702,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002276,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01060238,"duration_s":0.06525,"completed_at":"2026-09-04T06:47:49.999Z","load_balancing_strategy":"primary","db_duration_s":0.009193,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2327gitlab # [ 426.503096] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3472328gitlab # [ 426.505717] gitaly[908]: time="2026-09-04T06:47:49.988Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:47:59.034" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:49.974" grpc.time_ms=13.951 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2329gitlab # [ 426.519045] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.001Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","8259c437e0aa96f36bfccdc8"],"class":"WebHooks::LogExecutionWorker","jid":"54d7d97d122ad3966d876c84","created_at":"2026-09-04T06:47:47.993Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-c51ba51349d54b28","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2e64b423c3980c723ce6737283e3ca04864fee84e3665faa234979790a47ec17","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:48.008Z","job_size_bytes":2592,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-54d7d97d122ad3966d876c84: start","job_status":"start","queue_duration_s":1.992569,"scheduling_latency_s":1.992589}2330gitlab # [ 426.535596] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.060Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","8259c437e0aa96f36bfccdc8"],"class":"WebHooks::LogExecutionWorker","jid":"54d7d97d122ad3966d876c84","created_at":"2026-09-04T06:47:47.993Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-c51ba51349d54b28","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2e64b423c3980c723ce6737283e3ca04864fee84e3665faa234979790a47ec17","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:48.008Z","job_size_bytes":2592,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-54d7d97d122ad3966d876c84: done: 0.059474 sec","job_status":"done","queue_duration_s":1.992569,"scheduling_latency_s":1.992589,"redis_calls":10,"redis_duration_s":0.002686,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000439,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00062,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041672,"duration_s":0.059474,"completed_at":"2026-09-04T06:47:50.060Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2331gitlab # [ 426.579504] gitaly[908]: time="2026-09-04T06:47:50.009Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T06:48:00.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:47:50.008" grpc.time_ms=0.246 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 426.590371] nixbot[3533]: {"ts": "2026-09-04T06:47:50.377Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-b90a2947e4ec-5", "argv0": "bwrap"}2333gitlab # [ 426.592802] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.063Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"805a96e796165c9c210542fc","created_at":"2026-09-04T06:47:48.666Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-98286ffd46d74f3a","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:48.674Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-805a96e796165c9c210542fc: start","job_status":"start","queue_duration_s":1.389251,"scheduling_latency_s":1.389271}2334gitlab # [ 426.608111] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.400Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"805a96e796165c9c210542fc","created_at":"2026-09-04T06:47:48.666Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-98286ffd46d74f3a","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:48.674Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3467,"job_status":"rescheduled","message":"PipelineProcessWorker JID-805a96e796165c9c210542fc: rescheduled"}2335gitlab # [ 426.622668] gitaly[908]: time="2026-09-04T06:47:50.024Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T06:48:00.014" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:50.014" grpc.time_ms=9.858 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab # [ 426.636790] gitaly[908]: time="2026-09-04T06:47:50.069Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:47:50.068" grpc.time_ms=0.639 pid=908 span.kind=server system=grpc2337gitlab # [ 426.646315] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.410Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"805a96e796165c9c210542fc","created_at":"2026-09-04T06:47:48.666Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-98286ffd46d74f3a","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:48.674Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-805a96e796165c9c210542fc: done: 0.346536 sec","job_status":"done","queue_duration_s":1.389251,"scheduling_latency_s":1.389271,"gitaly_calls":3,"gitaly_duration_s":0.118882,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.017314,"redis_read_bytes":151,"redis_write_bytes":18016,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000475,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001064,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002788,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12315,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.007722,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00027,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000428,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.004092,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170995,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.29247798,"duration_s":0.346536,"completed_at":"2026-09-04T06:47:50.410Z","load_balancing_strategy":"primary","db_duration_s":0.051543,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2338gitlab # [ 426.696168] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.412Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","fceacb5fdc4a4760ef133a00"],"class":"WebHooks::LogExecutionWorker","jid":"be1b2fdf98fd1355ab0c833c","created_at":"2026-09-04T06:47:49.200Z","trace_propagation_headers":{"sentry-trace":"926dc0f02bfe41759ad55f335b97015a-fd995932c85c46ce","baggage":"sentry-trace_id=926dc0f02bfe41759ad55f335b97015a,sentry-release=Unknown"},"correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:77854bd31263a50771bc94095c45ade9a68104c179f3e0398a59c06e8ae187d0","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:49.204Z","job_size_bytes":2592,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-be1b2fdf98fd1355ab0c833c: start","job_status":"start","queue_duration_s":1.207277,"scheduling_latency_s":1.207306}2339gitlab # [ 426.713043] gitaly[908]: time="2026-09-04T06:47:50.094Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:47:50.094" grpc.time_ms=0.355 pid=908 span.kind=server system=grpc2340gitlab # [ 426.722218] gitaly[908]: time="2026-09-04T06:47:50.103Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB diskcache=198468e6-f8aa-483f-b8e7-4bffdb7b48a4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:48:00.027" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:47:50.028" pid=908 ref=refs/keep-around/b90a2947e4ec238146b91709b3d9a650dbfeedf8 remote_ip="2001:db8:1::1" revision=b90a2947e4ec238146b91709b3d9a650dbfeedf8 span.kind=server system=grpc username=root2341gitlab # [ 426.733475] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.442Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","fceacb5fdc4a4760ef133a00"],"class":"WebHooks::LogExecutionWorker","jid":"be1b2fdf98fd1355ab0c833c","created_at":"2026-09-04T06:47:49.200Z","trace_propagation_headers":{"sentry-trace":"926dc0f02bfe41759ad55f335b97015a-fd995932c85c46ce","baggage":"sentry-trace_id=926dc0f02bfe41759ad55f335b97015a,sentry-release=Unknown"},"correlation_id":"01M1NJP4KG24Y2HZ8TTKJ5F6CM","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:77854bd31263a50771bc94095c45ade9a68104c179f3e0398a59c06e8ae187d0","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:49.204Z","job_size_bytes":2592,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-be1b2fdf98fd1355ab0c833c: done: 0.030276 sec","job_status":"done","queue_duration_s":1.207277,"scheduling_latency_s":1.207306,"redis_calls":7,"redis_duration_s":0.001484,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00106,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000424,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030276,"completed_at":"2026-09-04T06:47:50.442Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003856,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2342gitlab # [ 426.775913] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.444Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"10d5abdacf6a3bf8a49a7d0e","created_at":"2026-09-04T06:47:49.978Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-c0013c2b17114736","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:49.985Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-10d5abdacf6a3bf8a49a7d0e: start","job_status":"start","queue_duration_s":0.458867,"scheduling_latency_s":0.45889}2343gitlab # [ 426.792866] gitaly[908]: time="2026-09-04T06:47:50.103Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=67 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5083 command.oublock=8 command.real_time_ms=68 command.spawn_token_fork_ms=5 command.system_time_ms=41 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T06:48:00.027" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T06:47:50.028" grpc.time_ms=75.089 pid=908 ref=refs/keep-around/b90a2947e4ec238146b91709b3d9a650dbfeedf8 remote_ip="2001:db8:1::1" revision=b90a2947e4ec238146b91709b3d9a650dbfeedf8 span.kind=server system=grpc username=root2344gitlab # [ 426.807973] nix-daemon[3775]: accepted connection from pid 4453, user nixbot2345gitlab # [ 426.809043] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.551Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"10d5abdacf6a3bf8a49a7d0e","created_at":"2026-09-04T06:47:49.978Z","trace_propagation_headers":{"sentry-trace":"6675df5b647a409d947661339a4fa923-c0013c2b17114736","baggage":"sentry-trace_id=6675df5b647a409d947661339a4fa923,sentry-release=Unknown"},"correlation_id":"01M1NJNXCHZM0GTABD166NVMSX","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:49.985Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-10d5abdacf6a3bf8a49a7d0e: done: 0.107016 sec","job_status":"done","queue_duration_s":0.458867,"scheduling_latency_s":0.45889,"redis_calls":11,"redis_duration_s":0.002687,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000463,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001726,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003677,"duration_s":0.107016,"completed_at":"2026-09-04T06:47:50.551Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028677,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2346gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8'2347gitlab # [ 426.855096] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.552Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"cb9aceb0db20c77de248659c","created_at":"2026-09-04T06:47:50.108Z","trace_propagation_headers":{"sentry-trace":"836a39acb2f14bbcb4d43292140e5af4-021c011e46e34f62","baggage":"sentry-trace_id=836a39acb2f14bbcb4d43292140e5af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJRWBCGK95N6S05D6EQPKB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.112Z","job_size_bytes":65,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-cb9aceb0db20c77de248659c: start","job_status":"start","queue_duration_s":0.440179,"scheduling_latency_s":0.440197}2348gitlab # [ 426.871745] gitaly[908]: time="2026-09-04T06:47:50.107Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:20.006" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:50.106" grpc.time_ms=0.365 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2349gitlab # [ 426.883634] gitaly[908]: time="2026-09-04T06:47:50.197Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJRTXNS575SVETF8HN66SE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:47:50.197" grpc.time_ms=0.405 pid=908 span.kind=server system=grpc2350gitlab # [ 426.892666] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.588Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"cb9aceb0db20c77de248659c","created_at":"2026-09-04T06:47:50.108Z","trace_propagation_headers":{"sentry-trace":"836a39acb2f14bbcb4d43292140e5af4-021c011e46e34f62","baggage":"sentry-trace_id=836a39acb2f14bbcb4d43292140e5af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJRWBCGK95N6S05D6EQPKB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.112Z","job_size_bytes":65,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-cb9aceb0db20c77de248659c: done: 0.036058 sec","job_status":"done","queue_duration_s":0.440179,"scheduling_latency_s":0.440197,"redis_calls":7,"redis_duration_s":0.002047,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036058,"completed_at":"2026-09-04T06:47:50.588Z","load_balancing_strategy":"primary","db_duration_s":0.008881,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2351gitlab # [ 426.934019] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.590Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"737cfbee21a2760041173668","created_at":"2026-09-04T06:47:50.113Z","trace_propagation_headers":{"sentry-trace":"836a39acb2f14bbcb4d43292140e5af4-021c011e46e34f62","baggage":"sentry-trace_id=836a39acb2f14bbcb4d43292140e5af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJRWBCGK95N6S05D6EQPKB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.116Z","job_size_bytes":65,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-737cfbee21a2760041173668: start","job_status":"start","queue_duration_s":0.474532,"scheduling_latency_s":0.474552}2352gitlab # [ 426.951372] gitaly[908]: time="2026-09-04T06:47:50.229Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJRTXNS575SVETF8HN66SE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:47:50.228" grpc.time_ms=0.412 pid=908 span.kind=server system=grpc2353gitlab # [ 426.960929] gitaly[908]: time="2026-09-04T06:47:50.261Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJRTXNS575SVETF8HN66SE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:47:50.260" grpc.time_ms=0.415 pid=908 span.kind=server system=grpc2354gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8', in 0.11 seconds)2355(finished: subtest: push delivers the webhook, in 91.20 seconds)2356subtest: eval and build post commit statuses2357gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses2358gitlab # [ 426.970462] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.689Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"737cfbee21a2760041173668","created_at":"2026-09-04T06:47:50.113Z","trace_propagation_headers":{"sentry-trace":"836a39acb2f14bbcb4d43292140e5af4-021c011e46e34f62","baggage":"sentry-trace_id=836a39acb2f14bbcb4d43292140e5af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJRWBCGK95N6S05D6EQPKB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.116Z","job_size_bytes":65,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-737cfbee21a2760041173668: done: 0.098744 sec","job_status":"done","queue_duration_s":0.474532,"scheduling_latency_s":0.474552,"redis_calls":10,"redis_duration_s":0.003523,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001498,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002025,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.098744,"completed_at":"2026-09-04T06:47:50.689Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2359gitlab # [ 427.013174] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.691Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"30aff8b35da28a3e2771fea1","created_at":"2026-09-04T06:47:50.150Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.153Z","job_size_bytes":23,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-30aff8b35da28a3e2771fea1: start","job_status":"start","queue_duration_s":0.538329,"scheduling_latency_s":0.538359}2360gitlab # [ 427.029846] nixbot[3533]: INFO: ::ffff:127.0.0.1:45998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 200 OK2361gitlab # [ 427.031740] gitaly[908]: time="2026-09-04T06:47:50.268Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRTXNS575SVETF8HN66SE diskcache=9b4a81f6-3aed-437a-bf4b-a6c76a44a4bc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:48:20.060" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:50.161" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2362gitlab # [ 427.041482] gitaly[908]: time="2026-09-04T06:47:50.269Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=102 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7405 command.oublock=0 command.real_time_ms=101 command.spawn_token_fork_ms=0 command.system_time_ms=42 command.user_time_ms=60 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRTXNS575SVETF8HN66SE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:48:20.060" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:50.161" grpc.time_ms=107.686 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2363gitlab # [ 427.055903] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.778Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"30aff8b35da28a3e2771fea1","created_at":"2026-09-04T06:47:50.150Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.153Z","job_size_bytes":23,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-30aff8b35da28a3e2771fea1: done: 0.086495 sec","job_status":"done","queue_duration_s":0.538329,"scheduling_latency_s":0.538359,"redis_calls":7,"redis_duration_s":0.014596000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00457,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.010026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.086495,"completed_at":"2026-09-04T06:47:50.778Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022409,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2364gitlab # [ 427.098114] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.781Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"579e50cbe6a14242f7ed1ecf","created_at":"2026-09-04T06:47:50.194Z","trace_propagation_headers":{"sentry-trace":"836a39acb2f14bbcb4d43292140e5af4-021c011e46e34f62","baggage":"sentry-trace_id=836a39acb2f14bbcb4d43292140e5af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJRWBCGK95N6S05D6EQPKB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.198Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-579e50cbe6a14242f7ed1ecf: start","job_status":"start","queue_duration_s":0.582718,"scheduling_latency_s":0.582747}2365gitlab # [ 427.113687] gitaly[908]: time="2026-09-04T06:47:50.338Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJRTXNS575SVETF8HN66SE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:48:20.236" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:50.337" grpc.time_ms=1.166 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2366gitlab # [ 427.126215] gitaly[908]: time="2026-09-04T06:47:50.390Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRTXNS575SVETF8HN66SE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:20.289" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:50.389" grpc.time_ms=0.714 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2367gitlab # [ 427.138366] gitaly[908]: time="2026-09-04T06:47:50.907Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:48:20.805" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:50.906" grpc.time_ms=1.683 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2368gitlab # [ 427.150669] gitaly[908]: time="2026-09-04T06:47:50.966Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRXAMVJ39HBR08H5ZMD7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:20.863" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:50.965" grpc.time_ms=1.598 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2369gitlab # [ 427.164601] gitaly[908]: time="2026-09-04T06:47:50.969Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRWBCGK95N6S05D6EQPKB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:20.867" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:50.968" grpc.time_ms=1.145 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2370gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses, in 0.22 seconds)2371gitlab # [ 427.176873] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:50.994Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"579e50cbe6a14242f7ed1ecf","created_at":"2026-09-04T06:47:50.194Z","trace_propagation_headers":{"sentry-trace":"836a39acb2f14bbcb4d43292140e5af4-021c011e46e34f62","baggage":"sentry-trace_id=836a39acb2f14bbcb4d43292140e5af4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJRWBCGK95N6S05D6EQPKB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.198Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-579e50cbe6a14242f7ed1ecf: done: 0.213504 sec","job_status":"done","queue_duration_s":0.582718,"scheduling_latency_s":0.582747,"gitaly_calls":2,"gitaly_duration_s":0.011219,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.026667,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.003953,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002056,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000497,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.008259,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000413,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001056,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00648,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.140603,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15259836,"duration_s":0.213504,"completed_at":"2026-09-04T06:47:50.994Z","load_balancing_strategy":"primary","db_duration_s":0.049028,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2372gitlab # [ 427.226616] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.000Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2981a6eb4e8e66eab0eb5f63","created_at":"2026-09-04T06:47:50.274Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.277Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2981a6eb4e8e66eab0eb5f63: start","job_status":"start","queue_duration_s":0.722386,"scheduling_latency_s":0.722417}2373gitlab # [ 427.242861] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.045Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2981a6eb4e8e66eab0eb5f63","created_at":"2026-09-04T06:47:50.274Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.277Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2981a6eb4e8e66eab0eb5f63: done: 0.045305 sec","job_status":"done","queue_duration_s":0.722386,"scheduling_latency_s":0.722417,"redis_calls":7,"redis_duration_s":0.002729,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001812,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045305,"completed_at":"2026-09-04T06:47:51.045Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2374gitlab # [ 427.286367] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.047Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"97d6016ce4c7a0999e3f2e37","created_at":"2026-09-04T06:47:50.286Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.289Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-97d6016ce4c7a0999e3f2e37: start","job_status":"start","queue_duration_s":0.758155,"scheduling_latency_s":0.758186}2375gitlab # [ 427.302395] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1552376gitlab # [ 427.304988] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.090Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"97d6016ce4c7a0999e3f2e37","created_at":"2026-09-04T06:47:50.286Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.289Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-97d6016ce4c7a0999e3f2e37: done: 0.04284 sec","job_status":"done","queue_duration_s":0.758155,"scheduling_latency_s":0.758186,"redis_calls":7,"redis_duration_s":0.002329,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000682,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04284,"completed_at":"2026-09-04T06:47:51.090Z","load_balancing_strategy":"primary","db_duration_s":0.008628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2377gitlab # [ 427.345964] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.092Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d8b6e05f75af08f754f42d7d","created_at":"2026-09-04T06:47:50.298Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.301Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d8b6e05f75af08f754f42d7d: start","job_status":"start","queue_duration_s":0.791601,"scheduling_latency_s":0.791625}2378gitlab # [ 427.361583] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.134Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d8b6e05f75af08f754f42d7d","created_at":"2026-09-04T06:47:50.298Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.301Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d8b6e05f75af08f754f42d7d: done: 0.041603 sec","job_status":"done","queue_duration_s":0.791601,"scheduling_latency_s":0.791625,"redis_calls":10,"redis_duration_s":0.003033,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000913,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041603,"completed_at":"2026-09-04T06:47:51.134Z","load_balancing_strategy":"primary","db_duration_s":0.008802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2379gitlab # [ 427.404072] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.136Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9273bc6d7c7eeb77003286b8","created_at":"2026-09-04T06:47:50.301Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.304Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9273bc6d7c7eeb77003286b8: start","job_status":"start","queue_duration_s":0.83193,"scheduling_latency_s":0.831953}2380gitlab # [ 427.420295] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.181Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9273bc6d7c7eeb77003286b8","created_at":"2026-09-04T06:47:50.301Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.304Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9273bc6d7c7eeb77003286b8: done: 0.045358 sec","job_status":"done","queue_duration_s":0.83193,"scheduling_latency_s":0.831953,"redis_calls":7,"redis_duration_s":0.0028940000000000003,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0007,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045358,"completed_at":"2026-09-04T06:47:51.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2381gitlab # [ 427.463368] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.185Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"55ce2ab7a15f71077087d56d","created_at":"2026-09-04T06:47:50.304Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.307Z","job_size_bytes":19,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-55ce2ab7a15f71077087d56d: start","job_status":"start","queue_duration_s":0.877635,"scheduling_latency_s":0.877682}2382gitlab # [ 427.479523] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.244Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"55ce2ab7a15f71077087d56d","created_at":"2026-09-04T06:47:50.304Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.307Z","job_size_bytes":19,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-55ce2ab7a15f71077087d56d: done: 0.059509 sec","job_status":"done","queue_duration_s":0.877635,"scheduling_latency_s":0.877682,"redis_calls":8,"redis_duration_s":0.0035840000000000004,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002847,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000737,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059509,"completed_at":"2026-09-04T06:47:51.244Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007809,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2383gitlab # [ 427.521994] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.247Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9250e8aca13f3b0678c3a624","created_at":"2026-09-04T06:47:50.308Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.312Z","job_size_bytes":66,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9250e8aca13f3b0678c3a624: start","job_status":"start","queue_duration_s":0.935585,"scheduling_latency_s":0.935622}2384gitlab # [ 427.539005] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.290Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9250e8aca13f3b0678c3a624","created_at":"2026-09-04T06:47:50.308Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.312Z","job_size_bytes":66,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9250e8aca13f3b0678c3a624: done: 0.043267 sec","job_status":"done","queue_duration_s":0.935585,"scheduling_latency_s":0.935622,"redis_calls":7,"redis_duration_s":0.002798,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001988,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00081,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043267,"completed_at":"2026-09-04T06:47:51.290Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2385gitlab # [ 427.581773] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.293Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2ef3a71da7f0ef3fddc7ac82","created_at":"2026-09-04T06:47:50.312Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.314Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2ef3a71da7f0ef3fddc7ac82: start","job_status":"start","queue_duration_s":0.978776,"scheduling_latency_s":0.978807}2386gitlab # [ 427.597987] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.336Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2ef3a71da7f0ef3fddc7ac82","created_at":"2026-09-04T06:47:50.312Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.314Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2ef3a71da7f0ef3fddc7ac82: done: 0.043231 sec","job_status":"done","queue_duration_s":0.978776,"scheduling_latency_s":0.978807,"redis_calls":7,"redis_duration_s":0.002402,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000636,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043231,"completed_at":"2026-09-04T06:47:51.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2387gitlab # [ 427.639414] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.339Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e2ef7f94542cd37a45e6cf37","created_at":"2026-09-04T06:47:50.315Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.317Z","job_size_bytes":6,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e2ef7f94542cd37a45e6cf37: start","job_status":"start","queue_duration_s":1.021929,"scheduling_latency_s":1.021958}2388gitlab # [ 427.655039] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.360Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e2ef7f94542cd37a45e6cf37","created_at":"2026-09-04T06:47:50.315Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.317Z","job_size_bytes":6,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e2ef7f94542cd37a45e6cf37: done: 0.021487 sec","job_status":"done","queue_duration_s":1.021929,"scheduling_latency_s":1.021958,"redis_calls":7,"redis_duration_s":0.002075,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001521,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021487,"completed_at":"2026-09-04T06:47:51.360Z","load_balancing_strategy":"primary","db_duration_s":0.000704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2389gitlab # [ 427.697714] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.362Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d0898c0b0c4e540a868db85e","created_at":"2026-09-04T06:47:50.317Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.319Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d0898c0b0c4e540a868db85e: start","job_status":"start","queue_duration_s":1.042501,"scheduling_latency_s":1.042525}2390gitlab # [ 427.712772] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.394Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d0898c0b0c4e540a868db85e","created_at":"2026-09-04T06:47:50.317Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.319Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d0898c0b0c4e540a868db85e: done: 0.031906 sec","job_status":"done","queue_duration_s":1.042501,"scheduling_latency_s":1.042525,"redis_calls":7,"redis_duration_s":0.0021260000000000003,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000606,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031906,"completed_at":"2026-09-04T06:47:51.394Z","load_balancing_strategy":"primary","db_duration_s":0.005522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2391gitlab # [ 427.753641] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.396Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"497469e607a96e23496d7c23","created_at":"2026-09-04T06:47:50.401Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.403Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-497469e607a96e23496d7c23: start","job_status":"start","queue_duration_s":0.992098,"scheduling_latency_s":0.992119}2392gitlab # [ 427.768893] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.430Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"497469e607a96e23496d7c23","created_at":"2026-09-04T06:47:50.401Z","trace_propagation_headers":{"sentry-trace":"854fe850a4bf4db9a41cc96bc25acc16-55bcb5ee09b44c5b","baggage":"sentry-trace_id=854fe850a4bf4db9a41cc96bc25acc16,sentry-release=Unknown"},"correlation_id":"01M1NJRTXNS575SVETF8HN66SE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.403Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-497469e607a96e23496d7c23: done: 0.034547 sec","job_status":"done","queue_duration_s":0.992098,"scheduling_latency_s":0.992119,"redis_calls":8,"redis_duration_s":0.002412,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001872,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00054,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034547,"completed_at":"2026-09-04T06:47:51.430Z","load_balancing_strategy":"primary","db_duration_s":0.006765,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2393gitlab # [ 427.809601] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.432Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"80fb5f4b03ee26ebe7398482","created_at":"2026-09-04T06:47:50.882Z","trace_propagation_headers":{"sentry-trace":"836a39acb2f14bbcb4d43292140e5af4-cfb3f0093e574838","baggage":"sentry-trace_id=836a39acb2f14bbcb4d43292140e5af4,sentry-release=Unknown"},"correlation_id":"01M1NJRWBCGK95N6S05D6EQPKB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.885Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-80fb5f4b03ee26ebe7398482: start","job_status":"start","queue_duration_s":0.546747,"scheduling_latency_s":0.546769}2394gitlab # [ 427.825540] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:51.473Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"80fb5f4b03ee26ebe7398482","created_at":"2026-09-04T06:47:50.882Z","trace_propagation_headers":{"sentry-trace":"836a39acb2f14bbcb4d43292140e5af4-cfb3f0093e574838","baggage":"sentry-trace_id=836a39acb2f14bbcb4d43292140e5af4,sentry-release=Unknown"},"correlation_id":"01M1NJRWBCGK95N6S05D6EQPKB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:50.885Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-80fb5f4b03ee26ebe7398482: done: 0.041246 sec","job_status":"done","queue_duration_s":0.546747,"scheduling_latency_s":0.546769,"redis_calls":7,"redis_duration_s":0.00201,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001459,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041246,"completed_at":"2026-09-04T06:47:51.473Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2395gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses2396gitlab # [ 428.389055] gitaly[908]: time="2026-09-04T06:47:52.230Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRYHM84HJXXW4XWGGQC8S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:22.128" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:52.229" grpc.time_ms=1.174 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2397gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses, in 0.27 seconds)2398gitlab # [ 428.463449] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1882399gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses2400gitlab # [ 429.637596] gitaly[908]: time="2026-09-04T06:47:53.479Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJRZRK1906FRT3SQVVE50G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:23.377" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:53.478" grpc.time_ms=0.99 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2401gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses, in 0.23 seconds)2402gitlab # [ 429.698180] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1752403gitlab # [ 429.728853] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:53.569Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c850098a2ce8355b370fcdb1","created_at":"2026-09-04T06:47:53.476Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4dbe9d9933cad4604b989fb581d45c5b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.564Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c850098a2ce8355b370fcdb1: start","job_status":"start","queue_duration_s":0.005005,"scheduling_latency_s":0.005064}2404gitlab # [ 429.889237] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:53.731Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2405gitlab # [ 429.951889] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:53.793Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c850098a2ce8355b370fcdb1","created_at":"2026-09-04T06:47:53.476Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4dbe9d9933cad4604b989fb581d45c5b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.564Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c850098a2ce8355b370fcdb1: done: 0.223842 sec","job_status":"done","queue_duration_s":0.005005,"scheduling_latency_s":0.005064,"redis_calls":9,"redis_duration_s":0.036157,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.027816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002919,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.223842,"completed_at":"2026-09-04T06:47:53.793Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023981,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2406gitlab # [ 430.046587] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:53.803Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d9837f874276a58cb14e7c99","created_at":"2026-09-04T06:47:53.594Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"627428ccaf787b1fbd3d3518083e48f7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.610Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d9837f874276a58cb14e7c99: start","job_status":"start","queue_duration_s":0.192828,"scheduling_latency_s":0.192879}2407gitlab # [ 430.141502] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:53.982Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d9837f874276a58cb14e7c99","created_at":"2026-09-04T06:47:53.594Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"627428ccaf787b1fbd3d3518083e48f7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.610Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d9837f874276a58cb14e7c99: done: 0.179026 sec","job_status":"done","queue_duration_s":0.192828,"scheduling_latency_s":0.192879,"redis_calls":9,"redis_duration_s":0.01803,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002751,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009934,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005345,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.179026,"completed_at":"2026-09-04T06:47:53.982Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2408gitlab # [ 430.230426] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:53.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f6f31b3f29e2a74084dc485e","created_at":"2026-09-04T06:47:53.639Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2be77405491ad4faefc5221363fb4a7b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.666Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f6f31b3f29e2a74084dc485e: start","job_status":"start","queue_duration_s":0.327697,"scheduling_latency_s":0.327743}2409gitlab # [ 430.339315] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f6f31b3f29e2a74084dc485e","created_at":"2026-09-04T06:47:53.639Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2be77405491ad4faefc5221363fb4a7b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.666Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f6f31b3f29e2a74084dc485e: done: 0.184198 sec","job_status":"done","queue_duration_s":0.327697,"scheduling_latency_s":0.327743,"redis_calls":9,"redis_duration_s":0.079398,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.067152,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009613,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002633,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.184198,"completed_at":"2026-09-04T06:47:54.178Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2410gitlab # [ 430.430052] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1589ce0333135564fd16619e","created_at":"2026-09-04T06:47:53.688Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b14ccec3cee98324656288a5706af25","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.700Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1589ce0333135564fd16619e: start","job_status":"start","queue_duration_s":0.489889,"scheduling_latency_s":0.489938}2411gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses2412gitlab # [ 430.679029] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1589ce0333135564fd16619e","created_at":"2026-09-04T06:47:53.688Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b14ccec3cee98324656288a5706af25","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.700Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1589ce0333135564fd16619e: done: 0.330258 sec","job_status":"done","queue_duration_s":0.489889,"scheduling_latency_s":0.489938,"redis_calls":13,"redis_duration_s":0.0597,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.01484,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013621,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.031239,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.051,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00321666,"exclusive_lock_hold_duration_s":0.15840984,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.330258,"completed_at":"2026-09-04T06:47:54.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.090741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2413gitlab # [ 430.789702] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"357976411d9023be61cffeeb","created_at":"2026-09-04T06:47:53.713Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"907f44ba79f02f885d10e1b88209fecd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T06:47:53.733Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-357976411d9023be61cffeeb: start","job_status":"start","queue_duration_s":0.810371,"scheduling_latency_s":0.81042}2414gitlab # [ 430.807261] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.632Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2415gitlab # [ 430.811443] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.651Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"357976411d9023be61cffeeb","created_at":"2026-09-04T06:47:53.713Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"907f44ba79f02f885d10e1b88209fecd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T06:47:53.733Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-357976411d9023be61cffeeb: done: 0.106659 sec","job_status":"done","queue_duration_s":0.810371,"scheduling_latency_s":0.81042,"redis_calls":9,"redis_duration_s":0.004325,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000755,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002565,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.106659,"completed_at":"2026-09-04T06:47:54.650Z","load_balancing_strategy":"primary","db_duration_s":0.000959,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2416gitlab # [ 430.853825] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9a7aa79f080656b8900cdfb8","created_at":"2026-09-04T06:47:53.779Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a537a8ff517e0dd052a58a2e93afe061","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.800Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9a7aa79f080656b8900cdfb8: start","job_status":"start","queue_duration_s":0.853053,"scheduling_latency_s":0.853088}2417gitlab # [ 430.867995] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.673Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2418gitlab # [ 430.873348] gitaly[908]: time="2026-09-04T06:47:54.715Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS10BMS3T29WNYFQ0R7M3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:24.613" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:54.714" grpc.time_ms=0.824 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2419gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses, in 0.21 seconds)2420gitlab # [ 430.886523] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.712Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9a7aa79f080656b8900cdfb8","created_at":"2026-09-04T06:47:53.779Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a537a8ff517e0dd052a58a2e93afe061","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.800Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9a7aa79f080656b8900cdfb8: done: 0.059059 sec","job_status":"done","queue_duration_s":0.853053,"scheduling_latency_s":0.853088,"redis_calls":9,"redis_duration_s":0.002709,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000572,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059059,"completed_at":"2026-09-04T06:47:54.712Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001042,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2421gitlab # [ 430.930928] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3627bdf8beaa778046db1f12","created_at":"2026-09-04T06:47:53.811Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa8830f3f9763baca92e518a8d0d3a65","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.825Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3627bdf8beaa778046db1f12: start","job_status":"start","queue_duration_s":0.892733,"scheduling_latency_s":0.892757}2422gitlab # [ 430.945185] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.756Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3627bdf8beaa778046db1f12","created_at":"2026-09-04T06:47:53.811Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa8830f3f9763baca92e518a8d0d3a65","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.825Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3627bdf8beaa778046db1f12: done: 0.038483 sec","job_status":"done","queue_duration_s":0.892733,"scheduling_latency_s":0.892757,"redis_calls":11,"redis_duration_s":0.0034820000000000003,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001347,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00061412,"exclusive_lock_hold_duration_s":0.00631876,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.038483,"completed_at":"2026-09-04T06:47:54.756Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2423gitlab # [ 430.987291] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:54.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c550621de032ff9ba0509624","created_at":"2026-09-04T06:47:53.838Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08a2a5dd789a2075d1645e8cb43ea106","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.861Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c550621de032ff9ba0509624: start","job_status":"start","queue_duration_s":0.89888,"scheduling_latency_s":0.898925}2424gitlab # [ 431.001487] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1122425gitlab # [ 431.277165] nix-daemon[3775]: accepted connection from pid 4494, user nixbot2426gitlab # [ 431.294166] nix-daemon[3775]: accepted connection from pid 4453, user nixbot2427gitlab # [ 431.315941] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.157Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c550621de032ff9ba0509624","created_at":"2026-09-04T06:47:53.838Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08a2a5dd789a2075d1645e8cb43ea106","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.861Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c550621de032ff9ba0509624: done: 0.396817 sec","job_status":"done","queue_duration_s":0.89888,"scheduling_latency_s":0.898925,"redis_calls":11,"redis_duration_s":0.006855,"redis_read_bytes":9,"redis_write_bytes":1292,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000897,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002434,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.059,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.310486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00128732,"exclusive_lock_hold_duration_s":0.34658228,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.396817,"completed_at":"2026-09-04T06:47:55.157Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.092067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2428gitlab # [ 431.411566] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.160Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f0307dfec9d28af9e2b01e36","created_at":"2026-09-04T06:47:53.888Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8124f1e61fa805ea8cf47e7797c2037","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T06:47:53.905Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f0307dfec9d28af9e2b01e36: start","job_status":"start","queue_duration_s":1.255722,"scheduling_latency_s":1.255763}2429gitlab # [ 431.427957] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.187Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2430gitlab # [ 431.432630] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f0307dfec9d28af9e2b01e36","created_at":"2026-09-04T06:47:53.888Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8124f1e61fa805ea8cf47e7797c2037","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T06:47:53.905Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f0307dfec9d28af9e2b01e36: done: 0.042348 sec","job_status":"done","queue_duration_s":1.255722,"scheduling_latency_s":1.255763,"redis_calls":9,"redis_duration_s":0.002946,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000637,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00166,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000649,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042348,"completed_at":"2026-09-04T06:47:55.203Z","load_balancing_strategy":"primary","db_duration_s":0.000775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2431gitlab # [ 431.478068] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.205Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"144b94b6b0da2e0650b15174","created_at":"2026-09-04T06:47:53.913Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce551a45c640a3d1aa432cfd94f3737d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.937Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-144b94b6b0da2e0650b15174: start","job_status":"start","queue_duration_s":1.267631,"scheduling_latency_s":1.267666}2432gitlab # [ 431.783856] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"144b94b6b0da2e0650b15174","created_at":"2026-09-04T06:47:53.913Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce551a45c640a3d1aa432cfd94f3737d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.937Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-144b94b6b0da2e0650b15174: done: 0.420689 sec","job_status":"done","queue_duration_s":1.267631,"scheduling_latency_s":1.267666,"redis_calls":564,"redis_duration_s":0.102368,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00062,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001549,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.100199,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.362428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.420689,"completed_at":"2026-09-04T06:47:55.626Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000786,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2433gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses2434gitlab # [ 431.879113] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a9ea169caa4321ac5b675eb7","created_at":"2026-09-04T06:47:53.972Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5aad0234b623c5c6df97830c3482f41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.991Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a9ea169caa4321ac5b675eb7: start","job_status":"start","queue_duration_s":1.635885,"scheduling_latency_s":1.635902}2435gitlab # [ 431.919803] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.639Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2436gitlab # [ 431.927296] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a9ea169caa4321ac5b675eb7","created_at":"2026-09-04T06:47:53.972Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5aad0234b623c5c6df97830c3482f41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:53.991Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a9ea169caa4321ac5b675eb7: done: 0.018427 sec","job_status":"done","queue_duration_s":1.635885,"scheduling_latency_s":1.635902,"redis_calls":9,"redis_duration_s":0.002117,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000511,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000445,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018427,"completed_at":"2026-09-04T06:47:55.645Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2437gitlab # [ 432.003373] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0af3e9bad7fefbc688cf4723","created_at":"2026-09-04T06:47:54.005Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85047da82daf9635f4febe0b1d9cbfe8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.020Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0af3e9bad7fefbc688cf4723: start","job_status":"start","queue_duration_s":1.627046,"scheduling_latency_s":1.627066}2438gitlab # [ 432.019910] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.676Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0af3e9bad7fefbc688cf4723","created_at":"2026-09-04T06:47:54.005Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85047da82daf9635f4febe0b1d9cbfe8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.020Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0af3e9bad7fefbc688cf4723: done: 0.029236 sec","job_status":"done","queue_duration_s":1.627046,"scheduling_latency_s":1.627066,"redis_calls":11,"redis_duration_s":0.003162,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000538,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001332,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060524,"exclusive_lock_hold_duration_s":0.00900304,"duration_s":0.029236,"completed_at":"2026-09-04T06:47:55.676Z","load_balancing_strategy":"primary","db_duration_s":0.005889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2439gitlab # [ 432.061721] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"db8237d7030d0c959dada29f","created_at":"2026-09-04T06:47:54.110Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9fc433a5160c474948a68e1c0ea1b6e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.136Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-db8237d7030d0c959dada29f: start","job_status":"start","queue_duration_s":1.542385,"scheduling_latency_s":1.542403}2440gitlab # [ 432.076181] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"db8237d7030d0c959dada29f","created_at":"2026-09-04T06:47:54.110Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9fc433a5160c474948a68e1c0ea1b6e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.136Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-db8237d7030d0c959dada29f: done: 0.022001 sec","job_status":"done","queue_duration_s":1.542385,"scheduling_latency_s":1.542403,"redis_calls":11,"redis_duration_s":0.002871,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001155,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00125,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022001,"completed_at":"2026-09-04T06:47:55.700Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2441gitlab # [ 432.117232] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.702Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"4ae44e1884e5ef64a303255c","created_at":"2026-09-04T06:47:54.155Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90de40455b57254d747d3ce60d879d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.187Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-4ae44e1884e5ef64a303255c: start","job_status":"start","queue_duration_s":1.514358,"scheduling_latency_s":1.514375}2442gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses, in 0.23 seconds)2443gitlab # [ 432.130396] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"4ae44e1884e5ef64a303255c","created_at":"2026-09-04T06:47:54.155Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90de40455b57254d747d3ce60d879d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.187Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-4ae44e1884e5ef64a303255c: done: 0.034644 sec","job_status":"done","queue_duration_s":1.514358,"scheduling_latency_s":1.514375,"redis_calls":18,"redis_duration_s":0.003807,"redis_read_bytes":20,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000967,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000274,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00181,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000756,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034644,"completed_at":"2026-09-04T06:47:55.736Z","load_balancing_strategy":"primary","db_duration_s":0.003015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2444gitlab # [ 432.172611] gitaly[908]: time="2026-09-04T06:47:55.921Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS24ZBQCA84JV89J3WKF8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:25.819" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:55.920" grpc.time_ms=0.601 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2445gitlab # [ 432.184985] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1652446gitlab # [ 432.187549] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1a9927fe544fd800f4c5b173","created_at":"2026-09-04T06:47:54.198Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e544c2dd75b26f1940af6609d3f4ac5e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.212Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1a9927fe544fd800f4c5b173: start","job_status":"start","queue_duration_s":1.525879,"scheduling_latency_s":1.525897}2447gitlab # [ 432.202034] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1a9927fe544fd800f4c5b173","created_at":"2026-09-04T06:47:54.198Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e544c2dd75b26f1940af6609d3f4ac5e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.212Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1a9927fe544fd800f4c5b173: done: 0.054115 sec","job_status":"done","queue_duration_s":1.525879,"scheduling_latency_s":1.525897,"redis_calls":11,"redis_duration_s":0.0030410000000000003,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000462,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001293,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007166,"exclusive_lock_hold_duration_s":0.02476832,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.054115,"completed_at":"2026-09-04T06:47:55.792Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2448gitlab # [ 432.245657] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1dc74cfd57686e23a8d5d3eb","created_at":"2026-09-04T06:47:54.230Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed738c0698192c37ddb578f0297cb702","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.257Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1dc74cfd57686e23a8d5d3eb: start","job_status":"start","queue_duration_s":1.537125,"scheduling_latency_s":1.537143}2449gitlab # [ 432.259837] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.816Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1dc74cfd57686e23a8d5d3eb","created_at":"2026-09-04T06:47:54.230Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed738c0698192c37ddb578f0297cb702","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.257Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1dc74cfd57686e23a8d5d3eb: done: 0.022295 sec","job_status":"done","queue_duration_s":1.537125,"scheduling_latency_s":1.537143,"redis_calls":9,"redis_duration_s":0.002616,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00038,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022295,"completed_at":"2026-09-04T06:47:55.816Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000737,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2450gitlab # [ 432.300833] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.817Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"253da2676d24a758352031c7","created_at":"2026-09-04T06:47:54.285Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b55529c9f1a46bb66b6e84ff20c502ef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.305Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-253da2676d24a758352031c7: start","job_status":"start","queue_duration_s":1.512275,"scheduling_latency_s":1.512294}2451gitlab # [ 432.314798] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.829Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2452gitlab # [ 432.318389] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"253da2676d24a758352031c7","created_at":"2026-09-04T06:47:54.285Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b55529c9f1a46bb66b6e84ff20c502ef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.305Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-253da2676d24a758352031c7: done: 0.018477 sec","job_status":"done","queue_duration_s":1.512275,"scheduling_latency_s":1.512294,"redis_calls":9,"redis_duration_s":0.001302,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018477,"completed_at":"2026-09-04T06:47:55.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001638,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2453gitlab # [ 432.359541] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"bd5d4fd393ec2bb60dacc505","created_at":"2026-09-04T06:47:54.367Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"920734d8c0d195ef37e7e524854e8531","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.381Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-bd5d4fd393ec2bb60dacc505: start","job_status":"start","queue_duration_s":1.455847,"scheduling_latency_s":1.455865}2454gitlab # [ 432.374409] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"bd5d4fd393ec2bb60dacc505","created_at":"2026-09-04T06:47:54.367Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"920734d8c0d195ef37e7e524854e8531","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.381Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-bd5d4fd393ec2bb60dacc505: done: 0.036681 sec","job_status":"done","queue_duration_s":1.455847,"scheduling_latency_s":1.455865,"redis_calls":9,"redis_duration_s":0.0013540000000000002,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.036681,"completed_at":"2026-09-04T06:47:55.873Z","load_balancing_strategy":"primary","db_duration_s":0.015822,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2455gitlab # [ 432.416630] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:55.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3a623fb9e59f3396b0486913","created_at":"2026-09-04T06:47:54.425Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.445Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3a623fb9e59f3396b0486913: start","job_status":"start","queue_duration_s":1.430207,"scheduling_latency_s":1.430226}2456gitlab # [ 432.456901] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.120Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3a623fb9e59f3396b0486913","created_at":"2026-09-04T06:47:54.425Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.445Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3a623fb9e59f3396b0486913: done: 0.245759 sec","job_status":"done","queue_duration_s":1.430207,"scheduling_latency_s":1.430226,"redis_calls":70,"redis_duration_s":0.017861000000000002,"redis_read_bytes":118,"redis_write_bytes":42480,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001762,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.00086,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013978,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.221207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.245759,"completed_at":"2026-09-04T06:47:56.120Z","load_balancing_strategy":"primary","db_duration_s":0.006866,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2457gitlab # [ 432.524571] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ecbb545d504689796336a375","created_at":"2026-09-04T06:47:54.489Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a18a65429da471683073a14f89d6f23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T06:47:54.513Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ecbb545d504689796336a375: start","job_status":"start","queue_duration_s":1.608917,"scheduling_latency_s":1.608938}2458gitlab # [ 432.538733] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.160Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ecbb545d504689796336a375","created_at":"2026-09-04T06:47:54.489Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a18a65429da471683073a14f89d6f23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T06:47:54.513Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ecbb545d504689796336a375: done: 0.037745 sec","job_status":"done","queue_duration_s":1.608917,"scheduling_latency_s":1.608938,"redis_calls":9,"redis_duration_s":0.00229,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000468,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000508,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037745,"completed_at":"2026-09-04T06:47:56.160Z","load_balancing_strategy":"primary","db_duration_s":0.007284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2459gitlab # [ 432.579370] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.161Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"eaa125a4be0213485a4fe076","created_at":"2026-09-04T06:47:54.537Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de81ce7419979d3b48f0cd0064c5bcde","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.557Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-eaa125a4be0213485a4fe076: start","job_status":"start","queue_duration_s":1.60454,"scheduling_latency_s":1.60456}2460gitlab # [ 432.595298] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.196Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"eaa125a4be0213485a4fe076","created_at":"2026-09-04T06:47:54.537Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-fa0600addc2e44d6","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de81ce7419979d3b48f0cd0064c5bcde","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:54.557Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-eaa125a4be0213485a4fe076: done: 0.035069 sec","job_status":"done","queue_duration_s":1.60454,"scheduling_latency_s":1.60456,"redis_calls":12,"redis_duration_s":0.003405,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000553,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001745,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0093456,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.035069,"completed_at":"2026-09-04T06:47:56.196Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004368,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2461gitlab # [ 432.639157] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.198Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"531ca787b5d8e31d5ca5e008","created_at":"2026-09-04T06:47:55.717Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-3ab7536a71c54ee3","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90de40455b57254d747d3ce60d879d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:55.729Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-531ca787b5d8e31d5ca5e008: start","job_status":"start","queue_duration_s":0.468717,"scheduling_latency_s":0.468738}2462gitlab # [ 432.651511] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.218Z","message":"No existing merge request to be cleaned up."}2463gitlab # [ 432.653296] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.238Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"531ca787b5d8e31d5ca5e008","created_at":"2026-09-04T06:47:55.717Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-3ab7536a71c54ee3","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90de40455b57254d747d3ce60d879d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:55.729Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-531ca787b5d8e31d5ca5e008: done: 0.040061 sec","job_status":"done","queue_duration_s":0.468717,"scheduling_latency_s":0.468738,"redis_calls":12,"redis_duration_s":0.003876,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00075,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001304,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001822,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040061,"completed_at":"2026-09-04T06:47:56.238Z","load_balancing_strategy":"primary","db_duration_s":0.006789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2464gitlab # [ 432.692786] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.240Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"debba188899eabe0c4dc4070","created_at":"2026-09-04T06:47:55.717Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-3ab7536a71c54ee3","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90de40455b57254d747d3ce60d879d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:55.729Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-debba188899eabe0c4dc4070: start","job_status":"start","queue_duration_s":0.510877,"scheduling_latency_s":0.510909}2465gitlab # [ 432.704967] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.255Z","message":"No existing merge request to be cleaned up."}2466gitlab # [ 432.706614] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.269Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"debba188899eabe0c4dc4070","created_at":"2026-09-04T06:47:55.717Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-3ab7536a71c54ee3","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90de40455b57254d747d3ce60d879d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:55.729Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-debba188899eabe0c4dc4070: done: 0.028404 sec","job_status":"done","queue_duration_s":0.510877,"scheduling_latency_s":0.510909,"redis_calls":10,"redis_duration_s":0.003273,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00189,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028404,"completed_at":"2026-09-04T06:47:56.269Z","load_balancing_strategy":"primary","db_duration_s":0.003098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2467gitlab # [ 432.744716] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.271Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ada46adc080a11da59d73023","created_at":"2026-09-04T06:47:55.717Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-3ab7536a71c54ee3","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90de40455b57254d747d3ce60d879d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:55.729Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ada46adc080a11da59d73023: start","job_status":"start","queue_duration_s":0.541353,"scheduling_latency_s":0.541383}2468gitlab # [ 432.756831] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.289Z","message":"No existing merge request to be cleaned up."}2469gitlab # [ 432.758478] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.302Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ada46adc080a11da59d73023","created_at":"2026-09-04T06:47:55.717Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-3ab7536a71c54ee3","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90de40455b57254d747d3ce60d879d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:55.729Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ada46adc080a11da59d73023: done: 0.031632 sec","job_status":"done","queue_duration_s":0.541353,"scheduling_latency_s":0.541383,"redis_calls":10,"redis_duration_s":0.003309,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001826,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031632,"completed_at":"2026-09-04T06:47:56.302Z","load_balancing_strategy":"primary","db_duration_s":0.003632,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2470gitlab # [ 432.798141] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.306Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a2af34fd5ccb9eafe77b5918","created_at":"2026-09-04T06:47:55.717Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-3ab7536a71c54ee3","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90de40455b57254d747d3ce60d879d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:55.729Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a2af34fd5ccb9eafe77b5918: start","job_status":"start","queue_duration_s":0.576147,"scheduling_latency_s":0.576185}2471gitlab # [ 432.810611] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.323Z","message":"No existing merge request to be cleaned up."}2472gitlab # [ 432.812336] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.339Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a2af34fd5ccb9eafe77b5918","created_at":"2026-09-04T06:47:55.717Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-3ab7536a71c54ee3","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90de40455b57254d747d3ce60d879d2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:55.729Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a2af34fd5ccb9eafe77b5918: done: 0.033836 sec","job_status":"done","queue_duration_s":0.576147,"scheduling_latency_s":0.576185,"redis_calls":10,"redis_duration_s":0.003362,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001441,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001921,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033836,"completed_at":"2026-09-04T06:47:56.339Z","load_balancing_strategy":"primary","db_duration_s":0.003742,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2473gitlab # [ 432.849762] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"212ec0dddcb2751c06960062","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-212ec0dddcb2751c06960062: start","job_status":"start","queue_duration_s":0.231045,"scheduling_latency_s":0.231078}2474gitlab # [ 432.861983] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"212ec0dddcb2751c06960062","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-212ec0dddcb2751c06960062: done: 0.037047 sec","job_status":"done","queue_duration_s":0.231045,"scheduling_latency_s":0.231078,"redis_calls":15,"redis_duration_s":0.004576,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000797,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001206,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002573,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037047,"completed_at":"2026-09-04T06:47:56.378Z","load_balancing_strategy":"primary","db_duration_s":0.001107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2475gitlab # [ 432.902175] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3856e1037ec9035ced1fd51b","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3856e1037ec9035ced1fd51b: start","job_status":"start","queue_duration_s":0.270178,"scheduling_latency_s":0.27021}2476gitlab # [ 432.914471] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3856e1037ec9035ced1fd51b","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3856e1037ec9035ced1fd51b: done: 0.026796 sec","job_status":"done","queue_duration_s":0.270178,"scheduling_latency_s":0.27021,"redis_calls":13,"redis_duration_s":0.0035139999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001166,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002348,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026796,"completed_at":"2026-09-04T06:47:56.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2477gitlab # [ 432.953096] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1885832e12ba8ce9b897726","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1885832e12ba8ce9b897726: start","job_status":"start","queue_duration_s":0.29908,"scheduling_latency_s":0.299109}2478gitlab # [ 432.965235] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1885832e12ba8ce9b897726","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1885832e12ba8ce9b897726: done: 0.023276 sec","job_status":"done","queue_duration_s":0.29908,"scheduling_latency_s":0.299109,"redis_calls":13,"redis_duration_s":0.003172,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023276,"completed_at":"2026-09-04T06:47:56.433Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2479gitlab # [ 433.005135] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb65c3c22d4108a6a526183d","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb65c3c22d4108a6a526183d: start","job_status":"start","queue_duration_s":0.323982,"scheduling_latency_s":0.324006}2480gitlab # [ 433.017237] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb65c3c22d4108a6a526183d","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb65c3c22d4108a6a526183d: done: 0.020901 sec","job_status":"done","queue_duration_s":0.323982,"scheduling_latency_s":0.324006,"redis_calls":13,"redis_duration_s":0.003523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002496,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020901,"completed_at":"2026-09-04T06:47:56.455Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2481gitlab # [ 433.055865] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f802ae8468b9148e75e186e9","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f802ae8468b9148e75e186e9: start","job_status":"start","queue_duration_s":0.346865,"scheduling_latency_s":0.346888}2482gitlab # [ 433.068277] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f802ae8468b9148e75e186e9","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f802ae8468b9148e75e186e9: done: 0.023774 sec","job_status":"done","queue_duration_s":0.346865,"scheduling_latency_s":0.346888,"redis_calls":13,"redis_duration_s":0.003031,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023774,"completed_at":"2026-09-04T06:47:56.481Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2483gitlab # [ 433.106607] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01b2bdd09c1a73261c2125d9","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01b2bdd09c1a73261c2125d9: start","job_status":"start","queue_duration_s":0.372408,"scheduling_latency_s":0.372437}2484gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses2485gitlab # [ 433.118870] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01b2bdd09c1a73261c2125d9","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01b2bdd09c1a73261c2125d9: done: 0.019937 sec","job_status":"done","queue_duration_s":0.372408,"scheduling_latency_s":0.372437,"redis_calls":13,"redis_duration_s":0.0030340000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019937,"completed_at":"2026-09-04T06:47:56.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2486gitlab # [ 433.157432] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"933adfba964f1dfd74e168f4","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-933adfba964f1dfd74e168f4: start","job_status":"start","queue_duration_s":0.394171,"scheduling_latency_s":0.394197}2487gitlab # [ 433.169024] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"933adfba964f1dfd74e168f4","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-933adfba964f1dfd74e168f4: done: 0.021774 sec","job_status":"done","queue_duration_s":0.394171,"scheduling_latency_s":0.394197,"redis_calls":13,"redis_duration_s":0.0037749999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00273,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021774,"completed_at":"2026-09-04T06:47:56.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2488gitlab # [ 433.208747] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b25fb96a5f0719fbf4076fc","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b25fb96a5f0719fbf4076fc: start","job_status":"start","queue_duration_s":0.417882,"scheduling_latency_s":0.417909}2489gitlab # [ 433.221352] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b25fb96a5f0719fbf4076fc","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b25fb96a5f0719fbf4076fc: done: 0.018613 sec","job_status":"done","queue_duration_s":0.417882,"scheduling_latency_s":0.417909,"redis_calls":13,"redis_duration_s":0.002831,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001813,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018613,"completed_at":"2026-09-04T06:47:56.547Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2490gitlab # [ 433.260105] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f86fc6d7d4acb33980de291","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f86fc6d7d4acb33980de291: start","job_status":"start","queue_duration_s":0.438019,"scheduling_latency_s":0.438039}2491gitlab # [ 433.272295] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f86fc6d7d4acb33980de291","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f86fc6d7d4acb33980de291: done: 0.017096 sec","job_status":"done","queue_duration_s":0.438019,"scheduling_latency_s":0.438039,"redis_calls":13,"redis_duration_s":0.0029000000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017096,"completed_at":"2026-09-04T06:47:56.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2492gitlab # [ 433.310744] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bed736d1dc9996ef219e9253","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bed736d1dc9996ef219e9253: start","job_status":"start","queue_duration_s":0.457685,"scheduling_latency_s":0.457708}2493gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses, in 0.21 seconds)2494gitlab # [ 433.323347] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bed736d1dc9996ef219e9253","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bed736d1dc9996ef219e9253: done: 0.017404 sec","job_status":"done","queue_duration_s":0.457685,"scheduling_latency_s":0.457708,"redis_calls":13,"redis_duration_s":0.002694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001703,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017404,"completed_at":"2026-09-04T06:47:56.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2495gitlab # [ 433.361737] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d7a54ab0878c47ad594b426","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d7a54ab0878c47ad594b426: start","job_status":"start","queue_duration_s":0.476647,"scheduling_latency_s":0.476669}2496gitlab # [ 433.374198] gitaly[908]: time="2026-09-04T06:47:57.159Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS3CK4YVEA2V1D7Q3P0ME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:27.057" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:57.158" grpc.time_ms=0.879 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2497gitlab # [ 433.387176] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1152498gitlab # [ 433.390119] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d7a54ab0878c47ad594b426","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d7a54ab0878c47ad594b426: done: 0.017008 sec","job_status":"done","queue_duration_s":0.476647,"scheduling_latency_s":0.476669,"redis_calls":13,"redis_duration_s":0.0026880000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001724,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017008,"completed_at":"2026-09-04T06:47:56.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2499gitlab # [ 433.430160] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a0937d0743fa06cfe5a5410","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a0937d0743fa06cfe5a5410: start","job_status":"start","queue_duration_s":0.495169,"scheduling_latency_s":0.495189}2500gitlab # [ 433.442645] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a0937d0743fa06cfe5a5410","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a0937d0743fa06cfe5a5410: done: 0.017242 sec","job_status":"done","queue_duration_s":0.495169,"scheduling_latency_s":0.495189,"redis_calls":13,"redis_duration_s":0.0033179999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017242,"completed_at":"2026-09-04T06:47:56.623Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2501gitlab # [ 433.481236] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e09579af4555e50ec1214e5","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e09579af4555e50ec1214e5: start","job_status":"start","queue_duration_s":0.514622,"scheduling_latency_s":0.514643}2502gitlab # [ 433.493412] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e09579af4555e50ec1214e5","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e09579af4555e50ec1214e5: done: 0.01704 sec","job_status":"done","queue_duration_s":0.514622,"scheduling_latency_s":0.514643,"redis_calls":13,"redis_duration_s":0.002997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01704,"completed_at":"2026-09-04T06:47:56.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2503gitlab # [ 433.532178] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a96c034dbd9acecc888c2a3","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a96c034dbd9acecc888c2a3: start","job_status":"start","queue_duration_s":0.533148,"scheduling_latency_s":0.533167}2504gitlab # [ 433.544215] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a96c034dbd9acecc888c2a3","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a96c034dbd9acecc888c2a3: done: 0.017017 sec","job_status":"done","queue_duration_s":0.533148,"scheduling_latency_s":0.533167,"redis_calls":13,"redis_duration_s":0.003345,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002379,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017017,"completed_at":"2026-09-04T06:47:56.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2505gitlab # [ 433.582897] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2e0e4f0ea4170215945398c","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2e0e4f0ea4170215945398c: start","job_status":"start","queue_duration_s":0.551584,"scheduling_latency_s":0.551603}2506gitlab # [ 433.595259] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2e0e4f0ea4170215945398c","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2e0e4f0ea4170215945398c: done: 0.01579 sec","job_status":"done","queue_duration_s":0.551584,"scheduling_latency_s":0.551603,"redis_calls":13,"redis_duration_s":0.002857,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01579,"completed_at":"2026-09-04T06:47:56.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2507gitlab # [ 433.635012] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"814bc255b56ae24c1f358e70","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-814bc255b56ae24c1f358e70: start","job_status":"start","queue_duration_s":0.568856,"scheduling_latency_s":0.568875}2508gitlab # [ 433.647249] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"814bc255b56ae24c1f358e70","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-814bc255b56ae24c1f358e70: done: 0.015816 sec","job_status":"done","queue_duration_s":0.568856,"scheduling_latency_s":0.568875,"redis_calls":13,"redis_duration_s":0.00279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015816,"completed_at":"2026-09-04T06:47:56.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2509gitlab # [ 433.686067] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00125eb9c9ca7d71f00a3a71","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00125eb9c9ca7d71f00a3a71: start","job_status":"start","queue_duration_s":0.586016,"scheduling_latency_s":0.586034}2510gitlab # [ 433.698262] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00125eb9c9ca7d71f00a3a71","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00125eb9c9ca7d71f00a3a71: done: 0.015715 sec","job_status":"done","queue_duration_s":0.586016,"scheduling_latency_s":0.586034,"redis_calls":13,"redis_duration_s":0.002798,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001237,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001561,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015715,"completed_at":"2026-09-04T06:47:56.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2511gitlab # [ 433.736211] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b81a6ec436be113ad03d9b6","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b81a6ec436be113ad03d9b6: start","job_status":"start","queue_duration_s":0.603188,"scheduling_latency_s":0.603206}2512gitlab # [ 433.748228] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b81a6ec436be113ad03d9b6","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b81a6ec436be113ad03d9b6: done: 0.016549 sec","job_status":"done","queue_duration_s":0.603188,"scheduling_latency_s":0.603206,"redis_calls":13,"redis_duration_s":0.0032890000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001837,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016549,"completed_at":"2026-09-04T06:47:56.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2513gitlab # [ 433.786255] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6152b2758813ea8dea78fe8e","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6152b2758813ea8dea78fe8e: start","job_status":"start","queue_duration_s":0.621163,"scheduling_latency_s":0.621183}2514gitlab # [ 433.798448] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6152b2758813ea8dea78fe8e","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6152b2758813ea8dea78fe8e: done: 0.015499 sec","job_status":"done","queue_duration_s":0.621163,"scheduling_latency_s":0.621183,"redis_calls":13,"redis_duration_s":0.00276,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001841,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015499,"completed_at":"2026-09-04T06:47:56.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2515gitlab # [ 433.837479] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3915d11ac4fa0dbac73fbfc","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3915d11ac4fa0dbac73fbfc: start","job_status":"start","queue_duration_s":0.638289,"scheduling_latency_s":0.638305}2516gitlab # [ 433.849894] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3915d11ac4fa0dbac73fbfc","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3915d11ac4fa0dbac73fbfc: done: 0.01538 sec","job_status":"done","queue_duration_s":0.638289,"scheduling_latency_s":0.638305,"redis_calls":13,"redis_duration_s":0.0027359999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01538,"completed_at":"2026-09-04T06:47:56.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2517gitlab # [ 433.888733] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6312b86a776b79fa35aeb261","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6312b86a776b79fa35aeb261: start","job_status":"start","queue_duration_s":0.655056,"scheduling_latency_s":0.655072}2518gitlab # [ 433.901210] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6312b86a776b79fa35aeb261","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6312b86a776b79fa35aeb261: done: 0.015883 sec","job_status":"done","queue_duration_s":0.655056,"scheduling_latency_s":0.655072,"redis_calls":13,"redis_duration_s":0.002915,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015883,"completed_at":"2026-09-04T06:47:56.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2519gitlab # [ 433.940469] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5300c0536bdddd8946e8e99","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5300c0536bdddd8946e8e99: start","job_status":"start","queue_duration_s":0.672561,"scheduling_latency_s":0.672578}2520gitlab # [ 433.952864] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5300c0536bdddd8946e8e99","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5300c0536bdddd8946e8e99: done: 0.015865 sec","job_status":"done","queue_duration_s":0.672561,"scheduling_latency_s":0.672578,"redis_calls":13,"redis_duration_s":0.0029549999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015865,"completed_at":"2026-09-04T06:47:56.799Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2521gitlab # [ 433.992313] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6edd46ec364c6e32aae910d","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6edd46ec364c6e32aae910d: start","job_status":"start","queue_duration_s":0.689858,"scheduling_latency_s":0.689875}2522gitlab # [ 434.004607] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6edd46ec364c6e32aae910d","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6edd46ec364c6e32aae910d: done: 0.016005 sec","job_status":"done","queue_duration_s":0.689858,"scheduling_latency_s":0.689875,"redis_calls":13,"redis_duration_s":0.002932,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016005,"completed_at":"2026-09-04T06:47:56.816Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2523gitlab # [ 434.044502] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bc4c6eaad027b9ce7f7a703","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bc4c6eaad027b9ce7f7a703: start","job_status":"start","queue_duration_s":0.708155,"scheduling_latency_s":0.708175}2524gitlab # [ 434.057066] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bc4c6eaad027b9ce7f7a703","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bc4c6eaad027b9ce7f7a703: done: 0.015999 sec","job_status":"done","queue_duration_s":0.708155,"scheduling_latency_s":0.708175,"redis_calls":13,"redis_duration_s":0.002883,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015999,"completed_at":"2026-09-04T06:47:56.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2525gitlab # [ 434.094704] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bffe666993d13d3cb5e044a","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bffe666993d13d3cb5e044a: start","job_status":"start","queue_duration_s":0.725529,"scheduling_latency_s":0.725546}2526gitlab # [ 434.106636] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bffe666993d13d3cb5e044a","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bffe666993d13d3cb5e044a: done: 0.015472 sec","job_status":"done","queue_duration_s":0.725529,"scheduling_latency_s":0.725546,"redis_calls":13,"redis_duration_s":0.002761,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015472,"completed_at":"2026-09-04T06:47:56.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2527gitlab # [ 434.144284] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9452b526a299976a03e610b9","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9452b526a299976a03e610b9: start","job_status":"start","queue_duration_s":0.742408,"scheduling_latency_s":0.742423}2528gitlab # [ 434.156188] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9452b526a299976a03e610b9","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9452b526a299976a03e610b9: done: 0.015337 sec","job_status":"done","queue_duration_s":0.742408,"scheduling_latency_s":0.742423,"redis_calls":13,"redis_duration_s":0.002894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015337,"completed_at":"2026-09-04T06:47:56.868Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2529gitlab # [ 434.193630] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee783384d106b92e2b4993ae","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee783384d106b92e2b4993ae: start","job_status":"start","queue_duration_s":0.759129,"scheduling_latency_s":0.759145}2530gitlab # [ 434.205458] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee783384d106b92e2b4993ae","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee783384d106b92e2b4993ae: done: 0.015653 sec","job_status":"done","queue_duration_s":0.759129,"scheduling_latency_s":0.759145,"redis_calls":13,"redis_duration_s":0.002811,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015653,"completed_at":"2026-09-04T06:47:56.885Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2531gitlab # [ 434.243341] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be41c1aad04bfcb3ff3142c6","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be41c1aad04bfcb3ff3142c6: start","job_status":"start","queue_duration_s":0.776364,"scheduling_latency_s":0.776379}2532gitlab # [ 434.256742] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be41c1aad04bfcb3ff3142c6","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be41c1aad04bfcb3ff3142c6: done: 0.015647 sec","job_status":"done","queue_duration_s":0.776364,"scheduling_latency_s":0.776379,"redis_calls":13,"redis_duration_s":0.002811,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001837,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015647,"completed_at":"2026-09-04T06:47:56.902Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2533gitlab # [ 434.294139] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef386d2d3d2c06d33a8c8cc6","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef386d2d3d2c06d33a8c8cc6: start","job_status":"start","queue_duration_s":0.793501,"scheduling_latency_s":0.793518}2534gitlab # [ 434.306138] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef386d2d3d2c06d33a8c8cc6","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef386d2d3d2c06d33a8c8cc6: done: 0.015702 sec","job_status":"done","queue_duration_s":0.793501,"scheduling_latency_s":0.793518,"redis_calls":13,"redis_duration_s":0.002884,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015702,"completed_at":"2026-09-04T06:47:56.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2535gitlab # [ 434.343983] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3b9646b3aa45f9d635d6997","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3b9646b3aa45f9d635d6997: start","job_status":"start","queue_duration_s":0.811585,"scheduling_latency_s":0.811602}2536gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses2537gitlab # [ 434.356157] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3b9646b3aa45f9d635d6997","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3b9646b3aa45f9d635d6997: done: 0.015434 sec","job_status":"done","queue_duration_s":0.811585,"scheduling_latency_s":0.811602,"redis_calls":13,"redis_duration_s":0.002749,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001827,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015434,"completed_at":"2026-09-04T06:47:56.937Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2538gitlab # [ 434.391336] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4ce4ce91f3ea37ff07098af","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4ce4ce91f3ea37ff07098af: start","job_status":"start","queue_duration_s":0.828394,"scheduling_latency_s":0.82841}2539gitlab # [ 434.402771] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4ce4ce91f3ea37ff07098af","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4ce4ce91f3ea37ff07098af: done: 0.015627 sec","job_status":"done","queue_duration_s":0.828394,"scheduling_latency_s":0.82841,"redis_calls":13,"redis_duration_s":0.002726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001798,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015627,"completed_at":"2026-09-04T06:47:56.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2540gitlab # [ 434.440651] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bf06a3f931af0b8e5286e41","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bf06a3f931af0b8e5286e41: start","job_status":"start","queue_duration_s":0.845404,"scheduling_latency_s":0.84542}2541gitlab # [ 434.452566] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bf06a3f931af0b8e5286e41","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bf06a3f931af0b8e5286e41: done: 0.015537 sec","job_status":"done","queue_duration_s":0.845404,"scheduling_latency_s":0.84542,"redis_calls":13,"redis_duration_s":0.003045,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002139,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015537,"completed_at":"2026-09-04T06:47:56.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2542gitlab # [ 434.491753] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89483ba98209030a3f04f1b0","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89483ba98209030a3f04f1b0: start","job_status":"start","queue_duration_s":0.862373,"scheduling_latency_s":0.86239}2543gitlab # [ 434.503961] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89483ba98209030a3f04f1b0","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89483ba98209030a3f04f1b0: done: 0.015571 sec","job_status":"done","queue_duration_s":0.862373,"scheduling_latency_s":0.86239,"redis_calls":13,"redis_duration_s":0.002794,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001853,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015571,"completed_at":"2026-09-04T06:47:56.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2544gitlab # [ 434.542072] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:56.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d22f18c7e0e8123351142ad","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d22f18c7e0e8123351142ad: start","job_status":"start","queue_duration_s":0.879381,"scheduling_latency_s":0.879398}2545gitlab # [ 434.553967] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d22f18c7e0e8123351142ad","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d22f18c7e0e8123351142ad: done: 0.015719 sec","job_status":"done","queue_duration_s":0.879381,"scheduling_latency_s":0.879398,"redis_calls":13,"redis_duration_s":0.002925,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015719,"completed_at":"2026-09-04T06:47:57.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2546gitlab # [ 434.591840] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad6d2491abca94188c9020d0","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad6d2491abca94188c9020d0: start","job_status":"start","queue_duration_s":0.896598,"scheduling_latency_s":0.896615}2547gitlab # [ 434.604428] gitaly[908]: time="2026-09-04T06:47:58.392Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS4JNKP1S6FDZQBMD7JJB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:28.290" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:58.391" grpc.time_ms=1.209 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2548gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses, in 0.26 seconds)2549gitlab # [ 434.616627] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad6d2491abca94188c9020d0","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad6d2491abca94188c9020d0: done: 0.015342 sec","job_status":"done","queue_duration_s":0.896598,"scheduling_latency_s":0.896615,"redis_calls":13,"redis_duration_s":0.002638,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015342,"completed_at":"2026-09-04T06:47:57.022Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2550gitlab # [ 434.653855] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb6176bbc5ad71e5656e883b","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb6176bbc5ad71e5656e883b: start","job_status":"start","queue_duration_s":0.913389,"scheduling_latency_s":0.913406}2551gitlab # [ 434.666110] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1552552gitlab # [ 434.669528] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb6176bbc5ad71e5656e883b","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb6176bbc5ad71e5656e883b: done: 0.026215 sec","job_status":"done","queue_duration_s":0.913389,"scheduling_latency_s":0.913406,"redis_calls":13,"redis_duration_s":0.008041,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004582,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026215,"completed_at":"2026-09-04T06:47:57.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2553gitlab # [ 434.707236] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96d2871e223e6a4a9dba3371","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96d2871e223e6a4a9dba3371: start","job_status":"start","queue_duration_s":0.941151,"scheduling_latency_s":0.941168}2554gitlab # [ 434.719360] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96d2871e223e6a4a9dba3371","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96d2871e223e6a4a9dba3371: done: 0.016578 sec","job_status":"done","queue_duration_s":0.941151,"scheduling_latency_s":0.941168,"redis_calls":13,"redis_duration_s":0.0029140000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016578,"completed_at":"2026-09-04T06:47:57.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2555gitlab # [ 434.758349] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7275a1e2c6e03cebc8b3704c","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7275a1e2c6e03cebc8b3704c: start","job_status":"start","queue_duration_s":0.959139,"scheduling_latency_s":0.959155}2556gitlab # [ 434.770766] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7275a1e2c6e03cebc8b3704c","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7275a1e2c6e03cebc8b3704c: done: 0.016227 sec","job_status":"done","queue_duration_s":0.959139,"scheduling_latency_s":0.959155,"redis_calls":13,"redis_duration_s":0.002824,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016227,"completed_at":"2026-09-04T06:47:57.086Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2557gitlab # [ 434.809061] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5448c2251f0f0ecf19bfe650","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5448c2251f0f0ecf19bfe650: start","job_status":"start","queue_duration_s":0.977211,"scheduling_latency_s":0.97723}2558gitlab # [ 434.821005] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5448c2251f0f0ecf19bfe650","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5448c2251f0f0ecf19bfe650: done: 0.01619 sec","job_status":"done","queue_duration_s":0.977211,"scheduling_latency_s":0.97723,"redis_calls":13,"redis_duration_s":0.002855,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01619,"completed_at":"2026-09-04T06:47:57.104Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2559gitlab # [ 434.859460] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a599bafbedb8b539445a617","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a599bafbedb8b539445a617: start","job_status":"start","queue_duration_s":0.995154,"scheduling_latency_s":0.995171}2560gitlab # [ 434.871742] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a599bafbedb8b539445a617","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a599bafbedb8b539445a617: done: 0.015467 sec","job_status":"done","queue_duration_s":0.995154,"scheduling_latency_s":0.995171,"redis_calls":13,"redis_duration_s":0.002794,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015467,"completed_at":"2026-09-04T06:47:57.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2561gitlab # [ 434.911339] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9039c8eb4cb56b37b5c45bab","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9039c8eb4cb56b37b5c45bab: start","job_status":"start","queue_duration_s":1.012776,"scheduling_latency_s":1.012795}2562gitlab # [ 434.923447] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9039c8eb4cb56b37b5c45bab","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9039c8eb4cb56b37b5c45bab: done: 0.015934 sec","job_status":"done","queue_duration_s":1.012776,"scheduling_latency_s":1.012795,"redis_calls":13,"redis_duration_s":0.00276,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015934,"completed_at":"2026-09-04T06:47:57.139Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2563gitlab # [ 434.962641] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a010c6c9bb59572531b584b","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a010c6c9bb59572531b584b: start","job_status":"start","queue_duration_s":1.030156,"scheduling_latency_s":1.030172}2564gitlab # [ 434.974750] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a010c6c9bb59572531b584b","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a010c6c9bb59572531b584b: done: 0.015778 sec","job_status":"done","queue_duration_s":1.030156,"scheduling_latency_s":1.030172,"redis_calls":13,"redis_duration_s":0.002776,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015778,"completed_at":"2026-09-04T06:47:57.156Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2565gitlab # [ 435.013431] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b8a55490c271e5948227be1","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b8a55490c271e5948227be1: start","job_status":"start","queue_duration_s":1.050207,"scheduling_latency_s":1.050256}2566gitlab # [ 435.025402] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b8a55490c271e5948227be1","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b8a55490c271e5948227be1: done: 0.038378 sec","job_status":"done","queue_duration_s":1.050207,"scheduling_latency_s":1.050256,"redis_calls":13,"redis_duration_s":0.003919000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001356,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002563,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038378,"completed_at":"2026-09-04T06:47:57.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2567gitlab # [ 435.063601] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99e57ccaded87723cc8142d8","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99e57ccaded87723cc8142d8: start","job_status":"start","queue_duration_s":1.091248,"scheduling_latency_s":1.091281}2568gitlab # [ 435.075834] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99e57ccaded87723cc8142d8","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99e57ccaded87723cc8142d8: done: 0.030868 sec","job_status":"done","queue_duration_s":1.091248,"scheduling_latency_s":1.091281,"redis_calls":13,"redis_duration_s":0.0046370000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001787,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00285,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030868,"completed_at":"2026-09-04T06:47:57.232Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2569gitlab # [ 435.115552] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edf40ec7793c0c0b501414f0","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edf40ec7793c0c0b501414f0: start","job_status":"start","queue_duration_s":1.125328,"scheduling_latency_s":1.125365}2570gitlab # [ 435.127690] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edf40ec7793c0c0b501414f0","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edf40ec7793c0c0b501414f0: done: 0.031574 sec","job_status":"done","queue_duration_s":1.125328,"scheduling_latency_s":1.125365,"redis_calls":13,"redis_duration_s":0.00404,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001305,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002735,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031574,"completed_at":"2026-09-04T06:47:57.267Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2571gitlab # [ 435.165680] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"453cb432e2534e3f60263724","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-453cb432e2534e3f60263724: start","job_status":"start","queue_duration_s":1.159532,"scheduling_latency_s":1.159562}2572gitlab # [ 435.177707] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"453cb432e2534e3f60263724","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-453cb432e2534e3f60263724: done: 0.022917 sec","job_status":"done","queue_duration_s":1.159532,"scheduling_latency_s":1.159562,"redis_calls":13,"redis_duration_s":0.003213,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022917,"completed_at":"2026-09-04T06:47:57.293Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2573gitlab # [ 435.215823] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1933548dd1eef40223993fe2","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1933548dd1eef40223993fe2: start","job_status":"start","queue_duration_s":1.184376,"scheduling_latency_s":1.184396}2574gitlab # [ 435.227993] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1933548dd1eef40223993fe2","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1933548dd1eef40223993fe2: done: 0.019012 sec","job_status":"done","queue_duration_s":1.184376,"scheduling_latency_s":1.184396,"redis_calls":13,"redis_duration_s":0.0030759999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019012,"completed_at":"2026-09-04T06:47:57.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2575gitlab # [ 435.265866] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"775c58e9ac08a45cbc013220","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-775c58e9ac08a45cbc013220: start","job_status":"start","queue_duration_s":1.205176,"scheduling_latency_s":1.205193}2576gitlab # [ 435.277977] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"775c58e9ac08a45cbc013220","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-775c58e9ac08a45cbc013220: done: 0.030647 sec","job_status":"done","queue_duration_s":1.205176,"scheduling_latency_s":1.205193,"redis_calls":13,"redis_duration_s":0.005394,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003693,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030647,"completed_at":"2026-09-04T06:47:57.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2577gitlab # [ 435.317454] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f684fd87e10cfd1a01e77bed","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f684fd87e10cfd1a01e77bed: start","job_status":"start","queue_duration_s":1.23891,"scheduling_latency_s":1.238951}2578gitlab # [ 435.329587] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f684fd87e10cfd1a01e77bed","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f684fd87e10cfd1a01e77bed: done: 0.03721 sec","job_status":"done","queue_duration_s":1.23891,"scheduling_latency_s":1.238951,"redis_calls":13,"redis_duration_s":0.004239,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03721,"completed_at":"2026-09-04T06:47:57.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2579gitlab # [ 435.367640] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1b49c1bc5ca23b6a0575cb5","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1b49c1bc5ca23b6a0575cb5: start","job_status":"start","queue_duration_s":1.278209,"scheduling_latency_s":1.278237}2580gitlab # [ 435.379780] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:57.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1b49c1bc5ca23b6a0575cb5","created_at":"2026-09-04T06:47:55.899Z","trace_propagation_headers":{"sentry-trace":"0b32f1fbec824faa9b0f8a8f859f18bd-447ab4370f604666","baggage":"sentry-trace_id=0b32f1fbec824faa9b0f8a8f859f18bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"747fbf037fcc3b28f12bd5c648d053c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T06:47:56.110Z","job_size_bytes":2,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1b49c1bc5ca23b6a0575cb5: done: 0.025223 sec","job_status":"done","queue_duration_s":1.278209,"scheduling_latency_s":1.278237,"redis_calls":13,"redis_duration_s":0.003607,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00246,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025223,"completed_at":"2026-09-04T06:47:57.414Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2581gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses2582gitlab # [ 435.645255] nix-daemon[3775]: accepted connection from pid 4453, user nixbot2583gitlab # [ 435.804544] gitaly[908]: time="2026-09-04T06:47:59.643Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS5SQKMK1QZSB27PS1B5A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:29.540" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:59.641" grpc.time_ms=1.288 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2584gitlab # [ 435.831729] gitaly[908]: time="2026-09-04T06:47:59.672Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:29.370" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:47:59.671" grpc.time_ms=0.863 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2585gitlab # [ 435.852847] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1502586gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses, in 0.24 seconds)2587gitlab # [ 435.947050] gitaly[908]: time="2026-09-04T06:47:59.789Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:48:09.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:47:59.771" grpc.time_ms=17.572 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2588gitlab # [ 436.042013] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-09-04T06:47:59.882Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ec263fd5468d56e1bea6cd3a","created_at":"2026-09-04T06:47:59.862Z","trace_propagation_headers":{"sentry-trace":"12baa780ed534c17a36a8f2c2470ed9d-9165f6c70cc74639","baggage":"sentry-trace_id=12baa780ed534c17a36a8f2c2470ed9d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NJS5THE0FQ0WCE0BDQQTTK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T06:47:59.873Z","job_size_bytes":3,"pid":3467,"sidekiq_tid":"m8rn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ec263fd5468d56e1bea6cd3a: start","job_status":"start","queue_duration_s":0.008787,"scheduling_latency_s":0.008885}2589gitlab # [ 436.081847] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:47:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3362590gitlab # [ 436.087047] nixbot[3533]: {"ts": "2026-09-04T06:47:59.909Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b90a2947e4ec238146b91709b3d9a650dbfeedf8 \"HTTP/1.1 201 Created\""}2591gitlab # [ 436.187210] gitaly[908]: time="2026-09-04T06:48:00.029Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS65HXT1ZPF578FA2ZAJK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:30.027" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:48:00.028" grpc.time_ms=0.924 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2592gitlab # [ 436.256186] gitaly[908]: time="2026-09-04T06:48:00.098Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NJS65HXT1ZPF578FA2ZAJK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:48:10.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:48:00.080" grpc.time_ms=18.321 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2593gitlab # [ 436.340808] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:48:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2612594gitlab # [ 436.347429] nixbot[3533]: {"ts": "2026-09-04T06:48:00.185Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b90a2947e4ec238146b91709b3d9a650dbfeedf8 \"HTTP/1.1 201 Created\""}2595gitlab # [ 436.462178] gitaly[908]: time="2026-09-04T06:48:00.304Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS6E7VBMS3YGM78BJBK2A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:30.301" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:48:00.303" grpc.time_ms=1.045 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2596gitlab # [ 436.552753] gitaly[908]: time="2026-09-04T06:48:00.395Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NJS6E7VBMS3YGM78BJBK2A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T06:48:10.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:48:00.378" grpc.time_ms=16.447 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2597gitlab # [ 436.580977] gitaly[908]: time="2026-09-04T06:48:00.401Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:48:00.400" grpc.time_ms=0.545 pid=908 span.kind=server system=grpc2598gitlab # [ 436.595831] gitaly[908]: time="2026-09-04T06:48:00.436Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:48:00.436" grpc.time_ms=0.419 pid=908 span.kind=server system=grpc2599gitlab # [ 436.619600] gitaly[908]: time="2026-09-04T06:48:00.462Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T06:48:00.461" grpc.time_ms=0.839 pid=908 span.kind=server system=grpc2600gitlab # [ 436.632948] gitaly[908]: time="2026-09-04T06:48:00.473Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:48:30.246" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:48:00.347" operations="[repack_refs]" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2601gitlab # [ 436.647009] gitaly[908]: time="2026-09-04T06:48:00.475Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:48:30.246" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:48:00.347" pid=908 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-04 06:46:09.96744786 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2602gitlab # [ 436.666980] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:48:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b90a2947e4ec238146b91709b3d9a650dbfeedf8 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2892603gitlab # [ 436.670709] nixbot[3533]: {"ts": "2026-09-04T06:48:00.490Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b90a2947e4ec238146b91709b3d9a650dbfeedf8 \"HTTP/1.1 201 Created\""}2604gitlab # [ 436.674749] gitaly[908]: time="2026-09-04T06:48:00.495Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK diskcache=b95d922e-27dd-4b5e-a780-170985764e3d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:48:30.246" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:48:00.347" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2605gitlab # [ 436.688260] gitaly[908]: time="2026-09-04T06:48:00.495Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=115 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7933 command.oublock=0 command.real_time_ms=132 command.spawn_token_fork_ms=7 command.system_time_ms=70 command.user_time_ms=45 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:48:30.246" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:48:00.347" grpc.time_ms=147.298 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2606gitlab # [ 436.704243] gitaly[908]: time="2026-09-04T06:48:00.508Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:48:30.246" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:48:00.347" pid=908 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2607gitlab # [ 436.719266] gitaly[908]: time="2026-09-04T06:48:00.508Z" level=info msg="optimized repository" clean_stale_data_time=32.6425ms clean_work_trees_time="138.88µs" commit_graph_time=680ns correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.54µs" pid=908 prune_time=280ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.4µs" storage_name=default system=housekeeping total_time=32.8319ms2608gitlab # [ 436.727421] gitaly[908]: time="2026-09-04T06:48:00.509Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T06:48:30.246" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T06:48:00.347" pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2609gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses2610gitlab # [ 436.864733] gitaly[908]: time="2026-09-04T06:48:00.706Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NJS5THE0FQ0WCE0BDQQTTK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T06:48:30.604" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:48:00.705" grpc.time_ms=1.414 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2611gitlab # [ 436.963017] gitaly[908]: time="2026-09-04T06:48:00.805Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NJS6ZACFFC5B4R2WMFHPGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T06:48:30.804" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T06:48:00.804" grpc.time_ms=0.786 pid=908 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2612gitlab # [ 437.019455] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:06:48:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 1142613gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b90a2947e4ec238146b91709b3d9a650dbfeedf8/statuses, in 0.17 seconds)2614(finished: subtest: eval and build post commit statuses, in 10.06 seconds)2615(finished: run the VM test script, in 508.75 seconds)2616test script finished in 508.78s2617cleanup2618kill QemuMachine (pid 46)2619gitlab # [ 437.039266] gitaly[908]: time="2026-09-04T06:48:00.881Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NJS712DHRQQXAN4ZZ64RBK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2620gitlab # r2621(finished: cleanup, in 1.62 seconds)2622additionally exposed symbols:2623 gitlab,2624 vlan1,2625 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2626[]2627[]2628[]2629[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-04T06:46:18.961Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2630[]2631[]2632[]2633[]2634[]2635[]2636[]2637[]2638[]2639[]2640[]2641[]2642[]2643[]2644[]2645[]2646[]2647[]2648[]2649[]2650[]2651[]2652[]2653[]2654[]2655[]2656[]2657[]2658[]2659[]2660[]2661[]2662[]2663[]2664[]2665[]2666[]2667[]2668[]2669[]2670[]2671[]2672[]2673[]2674[]2675[]2676[]2677[]2678[]2679[]2680[]2681[]2682[]2683[]2684[]2685[]2686[]2687[]2688[]2689[]2690[]2691[]2692[]2693[]2694[]2695[]2696[]2697[]2698[]2699[]2700[]2701[]2702[]2703[]2704[]2705[]2706[]2707[]2708[]2709[]2710[]2711[]2712[]2713[]2714[]2715[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'b90a2947e4ec238146b91709b3d9a650dbfeedf8', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': [{'level': 'warning', 'message': "unable to download 'https://cache.nixos.org/…': Could not resolve hostname (6) Could not resolve host: cache.nixos.org", 'count': 1}], 'error': None, 'created_at': '2026-09-04T06:47:49.858303Z', 'started_at': '2026-09-04T06:47:50.225119Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2716[{'id': 5, 'sha': 'b90a2947e4ec238146b91709b3d9a650dbfeedf8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:47:50.184Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2717[{'id': 5, 'sha': 'b90a2947e4ec238146b91709b3d9a650dbfeedf8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:47:50.184Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2718[{'id': 5, 'sha': 'b90a2947e4ec238146b91709b3d9a650dbfeedf8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:47:50.184Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2719[{'id': 5, 'sha': 'b90a2947e4ec238146b91709b3d9a650dbfeedf8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:47:50.184Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2720[{'id': 5, 'sha': 'b90a2947e4ec238146b91709b3d9a650dbfeedf8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:47:50.184Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2721[{'id': 5, 'sha': 'b90a2947e4ec238146b91709b3d9a650dbfeedf8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:47:50.184Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2722[{'id': 5, 'sha': 'b90a2947e4ec238146b91709b3d9a650dbfeedf8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:47:50.184Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2723[{'id': 5, 'sha': 'b90a2947e4ec238146b91709b3d9a650dbfeedf8', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T06:47:50.184Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2724[{'id': 5, 'sha': 'b90a2947e4ec238146b91709b3d9a650dbfeedf8', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-04T06:47:50.184Z', 'started_at': None, 'finished_at': '2026-09-04T06:47:59.842Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'b90a2947e4ec238146b91709b3d9a650dbfeedf8', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-09-04T06:48:00.135Z', 'started_at': None, 'finished_at': '2026-09-04T06:48:00.443Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]