vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #355
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.QPImzM0637', fmt=raw size=107374182412(finished: start all VMs, in 73.25 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: 6a8b2a0a-d7a4-438d-8a75-120d633d765b19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2s0rff4injl4sqf27i9dxqpl36g3jl33-nixos-system-gitlab-test/init regInfo=/nix/store/kxn1ykikprmk2zc5zic86yi0r4q1c7mb-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/kxn1ykikprmk2zc5zic86yi0r4q1c7mb-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000026] arm-pv: using stolen time PV108gitlab # [ 0.000383] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000580] Console: colour dummy device 80x25110gitlab # [ 0.000587] printk: legacy console [tty0] enabled111gitlab # [ 0.000762] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000769] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000845] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001011] landlock: Up and running.115gitlab # [ 0.001014] Yama: becoming mindful.116gitlab # [ 0.001424] LSM support for eBPF active117gitlab # [ 0.001613] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001721] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002848] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003522] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003526] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003677] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004717] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004808] EFI services will not be available.125gitlab # [ 0.004979] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005623] Detected PIPT I-cache on CPU1127gitlab # [ 0.005722] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005853] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.005982] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007069] Detected PIPT I-cache on CPU2131gitlab # [ 0.007174] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007305] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007433] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008482] Detected PIPT I-cache on CPU3135gitlab # [ 0.008597] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008728] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008856] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009338] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009364] SMP: Total of 4 processors activated.140gitlab # [ 0.009366] CPU: All CPU(s) started at EL1141gitlab # [ 0.009375] CPU features: detected: Branch Target Identification142gitlab # [ 0.009378] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009381] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009384] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009388] CPU features: detected: Common not Private translations146gitlab # [ 0.009391] CPU features: detected: CRC32 instructions147gitlab # [ 0.009393] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009396] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009399] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009402] CPU features: detected: E0PD151gitlab # [ 0.009404] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009407] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009410] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009412] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009415] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009419] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009421] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009424] CPU features: detected: Privileged Access Never159gitlab # [ 0.009426] CPU features: detected: PMUv3160gitlab # [ 0.009429] CPU features: detected: RAS Extension Support161gitlab # [ 0.009431] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009434] CPU features: detected: Random Number Generator163gitlab # [ 0.009436] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009438] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009441] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009444] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009573] alternatives: applying system-wide alternatives168gitlab # [ 0.012448] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012673] Memory: 5963792K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014078] devtmpfs: initialized171gitlab # [ 0.017995] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018066] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018244] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018248] 0 pages in range for non-PLT usage175gitlab # [ 0.018249] 508288 pages in range for PLT usage176gitlab # [ 0.018366] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019148] DMI not present or invalid.178gitlab # [ 0.022342] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.025028] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025311] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.027167] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.027189] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027520] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.028012] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.028015] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.028020] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.028022] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.028025] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.028110] cpuidle: using governor ladder190gitlab # [ 0.028134] cpuidle: using governor menu191gitlab # [ 0.028335] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028552] ASID allocator initialised with 65536 entries193gitlab # [ 0.029663] Serial: AMBA PL011 UART driver194gitlab # [ 0.034697] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034987] printk: console [ttyAMA0] enabled196gitlab # [ 0.047493] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.047511] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.047520] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.047529] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.047537] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.047545] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.047553] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.047560] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.058903] fbcon: Taking over console205gitlab # [ 0.058928] ACPI: Interpreter disabled.206gitlab # [ 0.061489] iommu: Default domain type: Translated207gitlab # [ 0.061497] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.077174] SCSI subsystem initialized209gitlab # [ 0.077934] usbcore: registered new interface driver usbfs210gitlab # [ 0.077995] usbcore: registered new interface driver hub211gitlab # [ 0.078034] usbcore: registered new device driver usb212gitlab # [ 0.078817] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.078828] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.078850] PTP clock support registered215gitlab # [ 0.078952] EDAC MC: Ver: 3.0.0216gitlab # [ 0.079535] scmi_core: SCMI protocol bus registered217gitlab # [ 0.080608] FPGA manager framework218gitlab # [ 0.085028] vgaarb: loaded219gitlab # [ 0.086364] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.087041] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.087075] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.087870] netfs: FS-Cache loaded223gitlab # [ 0.088237] pnp: PnP ACPI: disabled224gitlab # [ 0.099263] NET: Registered PF_INET protocol family225gitlab # [ 0.101657] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.161226] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.161293] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.161351] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.161791] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.162749] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.162936] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.163004] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.163173] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.163442] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.163464] NET: Registered PF_XDP protocol family236gitlab # [ 0.163482] PCI: CLS 0 bytes, default 64237gitlab # [ 0.163727] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.175304] kvm [1]: HYP mode not available239gitlab # [ 0.247913] Initialise system trusted keyrings240gitlab # [ 0.248176] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.248879] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.248963] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.264293] Key type asymmetric registered244gitlab # [ 0.264312] Asymmetric key parser 'x509' registered245gitlab # [ 0.264461] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.264677] io scheduler mq-deadline registered247gitlab # [ 0.264685] io scheduler kyber registered248gitlab # [ 0.272072] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.274560] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.275016] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.275033] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.275044] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.275051] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.275072] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.275094] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.275221] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.275230] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.275234] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.275238] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.275242] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.275356] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.275989] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.276259] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.276274] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.276307] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.276323] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.276997] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.277273] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.277288] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.277320] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.277981] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.278256] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.278271] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.278304] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.279036] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.279298] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.279312] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.279345] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.279999] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.280266] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.280280] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.280313] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.280970] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.281211] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.281226] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.281265] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.281897] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.282161] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.282175] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.282222] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.282237] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.282948] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.283203] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.283235] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.283845] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.284091] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.284123] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.284657] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.284898] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.285223] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.285551] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.285565] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.285598] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.286220] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.286466] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.286481] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.286514] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.287248] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.287256] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.287261] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.287312] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.287380] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.287447] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.287500] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.287561] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.287614] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.287669] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.287726] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.287779] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.287865] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.287937] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.287959] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.287982] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.288010] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.288032] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.288060] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.288083] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.288105] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.288133] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.288155] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.288182] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.288205] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.288228] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.288256] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.288278] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.288305] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.288328] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.288356] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.288378] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.288401] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.288430] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.288456] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.288463] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.288467] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.290028] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.304393] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.307100] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.309642] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.312277] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.316153] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.320516] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.323032] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.325588] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.328194] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.334662] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.337479] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.343371] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.345560] msm_serial: driver initialized359gitlab # [ 0.345721] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.345785] STM32 USART driver initialized361gitlab # [ 0.372252] loop: module loaded362gitlab # [ 0.372503] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.374730] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.377108] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.379333] virtio_blk virtio5: [vdb] 12284984 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.381600] megasas: 07.734.00.00-rc1367gitlab # [ 0.382550] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.384962] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.384979] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.387032] Using buffer write method371gitlab # [ 0.387062] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.389301] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.389316] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.391257] Using buffer write method375gitlab # [ 0.391271] Concatenating MTD devices:376gitlab # [ 0.391273] (0): "0.flash"377gitlab # [ 0.391276] (1): "0.flash"378gitlab # [ 0.391278] into device "0.flash"379gitlab # [ 0.605217] Freeing initrd memory: 27184K380gitlab # [ 0.623572] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.631838] thunder_xcv, ver 1.0382gitlab # [ 0.631987] thunder_bgx, ver 1.0383gitlab # [ 0.632042] nicpf, ver 1.0384gitlab # [ 0.633767] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.633778] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.633840] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.633853] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.633939] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.633949] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.634008] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.634018] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.634550] sky2: driver version 1.30393gitlab # [ 0.638898] ehci-pci 0000:00:0a.0: EHCI Host Controller394gitlab # [ 0.638924] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1395gitlab # [ 0.639264] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000396gitlab # [ 0.639439] usbcore: registered new interface driver usb-storage397gitlab # [ 0.639671] usbcore: registered new interface driver usbserial_generic398gitlab # [ 0.639705] usbserial: USB Serial support registered for generic399gitlab # [ 0.641461] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.644036] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.644094] rtc-pl031 9010000.pl031: setting system clock to 2026-09-08T05:54:31 UTC (1788846871)402gitlab # [ 0.644988] i2c_dev: i2c /dev entries driver403gitlab # [ 0.650414] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.651061] hub 1-0:1.0: USB hub found405gitlab # [ 0.651113] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.653178] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.653191] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.653991] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.655139] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.659744] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.660677] usbcore: registered new interface driver usbhid412gitlab # [ 0.660688] usbhid: USB HID core driver413gitlab # [ 0.711359] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.715994] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.716276] NET: Registered PF_INET6 protocol family416gitlab # [ 0.718454] Segment Routing with IPv6417gitlab # [ 0.718490] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.718558] NET: Registered PF_PACKET protocol family419gitlab # [ 0.718843] 9pnet: Installing 9P2000 support420gitlab # [ 0.723282] Key type dns_resolver registered421gitlab # [ 0.742114] registered taskstats version 1422gitlab # [ 0.742876] Loading compiled-in X.509 certificates423gitlab # [ 0.769807] Demotion targets for Node 0: null424gitlab # [ 0.770118] Key type .fscrypt registered425gitlab # [ 0.770128] Key type fscrypt-provisioning registered426gitlab # [ 0.770493] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.770543] ima: Allocated hash algorithm: sha1428gitlab # [ 0.770603] ima: No architecture policies found429gitlab # [ 0.772173] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.804702] clk: Disabling unused clocks431gitlab # [ 0.804733] PM: genpd: Disabling unused power domains432gitlab # [ 0.810505] Freeing unused kernel memory: 4736K433gitlab # [ 0.810727] Run /init as init process434gitlab # [ 0.849956] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.934440] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.086870] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.174893] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0438gitlab # [ 1.184764] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.184831] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.184898] systemd[1]: Detected architecture arm64.441gitlab # [ 1.184914] systemd[1]: Running in initrd.442gitlab # [ 1.185715] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.186091] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.294452] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.409685] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.448720] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.449299] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.520661] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.537729] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.538011] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.538053] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.538071] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.538099] systemd[1]: Reached target Path Units.454gitlab # [ 1.538118] systemd[1]: Reached target Slice Units.455gitlab # [ 1.538140] systemd[1]: Reached target Swaps.456gitlab # [ 1.538161] systemd[1]: Reached target Timer Units.457gitlab # [ 1.538356] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.538655] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.538844] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.539021] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.539126] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.539153] systemd[1]: Reached target Socket Units.463gitlab # [ 1.541195] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.543228] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.543318] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.545335] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.573592] systemd[1]: Starting Journal Service...468gitlab # [ 1.575850] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.575967] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.582735] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.586910] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.589111] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.590034] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.591132] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.595410] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.624470] systemd-journald[95]: Collecting audit messages is disabled.477gitlab # [ 1.631225] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0478gitlab # [ 1.631476] [drm] features: -virgl +edid -resource_blob -host_visible479gitlab # [ 1.631495] [drm] features: -context_init480gitlab # [ 1.635082] [drm] number of scanouts: 1481gitlab # [ 1.635128] [drm] number of cap sets: 0482gitlab # [ 1.635583] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.483gitlab # [ 1.636222] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.484gitlab # [ 1.638579] systemd[1]: Starting Create Static Device Nodes in /dev...485gitlab # [ 1.638925] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic486gitlab # [ 1.638947] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0487gitlab # [ 1.642548] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev488gitlab # [ 1.652892] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.654131] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.665398] systemd[1]: Finished Load Kernel Modules.491gitlab # [ 1.668216] systemd[1]: Starting Apply Kernel Variables...492gitlab # [ 1.670637] systemd[1]: Finished Create Static Device Nodes in /dev.493gitlab # [ 1.671131] systemd[1]: Reached target Preparation for Local File Systems.494gitlab # [ 1.671657] systemd[1]: Reached target Local File Systems.495gitlab # [ 1.694716] systemd[1]: Starting Rule-based Manager for Device Events and Files...496gitlab # [ 1.704484] systemd[1]: Finished Apply Kernel Variables.497gitlab # [ 1.711013] systemd[1]: Started Journal Service.498gitlab # [ 1.708831] systemd-modules-load[96]: Using 4 probe threads499gitlab # [ 1.713025] systemd-modules-load[96]: Module 'virtio_balloon' is built in500gitlab # [ 1.714995] systemd-modules-load[96]: Module 'virtio_console' is built in501gitlab # [ 1.716273] systemd-modules-load[96]: Module 'virtio_rng' is built in502gitlab # [ 1.718668] systemd-modules-load[96]: Inserted module 'dm_mod'503gitlab # [ 1.719718] systemd-modules-load[96]: Inserted module 'virtio_gpu'504gitlab # [ 1.720870] systemd[1]: Starting Create System Files and Directories...505gitlab # [ 1.729893] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.737929] systemd-udevd[107]: Using default interface naming scheme 'v261'.507gitlab # [ 1.757980] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.776689] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.823351] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.826548] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.233848] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.236496] systemd[1]: Reached target System Initialization.513gitlab # [ 2.238916] systemd[1]: Reached target Basic System.514gitlab # [ 2.432540] (udev-worker)[145]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.440248] (udev-worker)[145]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.442964] (udev-worker)[147]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.468104] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.475788] systemd[1]: Found device /dev/disk/by-label/nix-store.519gitlab # [ 2.479871] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.481460] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.520681] systemd-fsck[153]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.526271] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.584405] systemd[1]: Mounting /sysroot...524gitlab # [ 2.621516] EXT4-fs (vda): mounted filesystem 6a8b2a0a-d7a4-438d-8a75-120d633d765b r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.621478] systemd[1]: Mounted /sysroot.526gitlab # [ 2.623593] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.625495] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.632568] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.634666] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.636432] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.650608] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.666779] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.533gitlab # [ 2.668323] systemd[1]: Starting Mountpoints Configured in the Real Root...[ 2.671991] erofs (device vdb): mounted with root inode @ nid 128.534gitlab # 535gitlab # [ 2.671415] systemd[1]: Mounted /sysroot/nix/.rw-store.536gitlab # [ 2.673358] systemd[1]: Mounted /sysroot/run.537gitlab # [ 2.674066] systemd[1]: Mounted /sysroot/tmp/shared.538gitlab # [ 2.674803] systemd[1]: Mounted /sysroot/nix/.ro-store.539gitlab # [ 2.676044] systemd[1]: Mounted /sysroot/tmp/xchg.540gitlab # [ 2.679312] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...541gitlab # [ 2.681232] systemd[1]: Reloading...542gitlab # [ 2.777412] systemd[1]: Reloading finished in 97 ms.543gitlab # [ 2.831739] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...544gitlab # [ 2.834371] systemd[1]: Starting rw-sysroot-nix-store.service...545gitlab # [ 2.836678] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...546gitlab # [ 2.840979] systemd[1]: initrd-parse-etc.service: Deactivated successfully.547gitlab # [ 2.852226] systemd[1]: Finished Mountpoints Configured in the Real Root.548gitlab # [ 2.853469] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.549gitlab # [ 2.857853] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.550gitlab # [ 2.858983] systemd[1]: Finished rw-sysroot-nix-store.service.551gitlab # [ 3.008977] (udev-worker)[140]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory552gitlab # [ 3.014537] (udev-worker)[140]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory553gitlab # [ 3.021463] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.554gitlab # [ 3.022903] systemd[1]: Stopped Virtual Console Setup.555gitlab # [ 3.023821] systemd[1]: Stopping Virtual Console Setup...556gitlab # [ 3.024706] systemd[1]: Starting Virtual Console Setup...557gitlab # [ 3.045022] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.558gitlab # [ 3.046165] systemd[1]: Stopped Virtual Console Setup.559gitlab # [ 3.046958] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 3.068903] systemd-vconsole-setup[195]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 3.070714] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 3.589727] systemd[1]: Mounting /sysroot/nix/store...563gitlab # [ 3.674022] systemd[1]: Mounted /sysroot/nix/store.564gitlab # [ 3.676407] systemd[1]: Reached target Initrd File Systems.565gitlab # [ 3.678828] systemd[1]: Starting Find NixOS closure...566gitlab # [ 3.681550] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...567gitlab # [ 3.728240] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.568gitlab # [ 3.731892] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.569gitlab # [ 3.752639] systemd[1]: Finished Find NixOS closure.570gitlab # [ 3.755075] systemd[1]: Reached target Initrd Default Target.571gitlab # [ 3.757788] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...572gitlab # [ 3.815072] systemd[1]: Stopped target Initrd Default Target.573gitlab # [ 3.817831] systemd[1]: Stopped target Basic System.574gitlab # [ 3.820028] systemd[1]: Stopped target Initrd Root Device.575gitlab # [ 3.822566] systemd[1]: Stopped target Path Units.576gitlab # [ 3.824742] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.577gitlab # [ 3.827881] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.578gitlab # [ 3.832159] systemd[1]: Stopped target Slice Units.579gitlab # [ 3.836119] systemd[1]: Stopped target Socket Units.580gitlab # [ 3.838298] systemd[1]: Stopped target System Initialization.581gitlab # [ 3.846160] systemd[1]: Stopped target Swaps.582gitlab # [ 3.848300] systemd[1]: Stopped target Timer Units.583gitlab # [ 3.850327] systemd[1]: dbus.socket: Deactivated successfully.584gitlab # [ 3.853008] systemd[1]: Closed D-Bus System Message Bus Socket.585gitlab # [ 3.855551] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.586gitlab # [ 3.858449] systemd[1]: Stopped Find NixOS closure.587gitlab # [ 3.860424] systemd[1]: Starting Load Kernel Module 9pnet_virtio...588gitlab # [ 3.862455] systemd[1]: Starting rw-sysroot-nix-store.service...589gitlab # [ 3.864473] systemd[1]: systemd-sysctl.service: Deactivated successfully.590gitlab # [ 3.866485] systemd[1]: Stopped Apply Kernel Variables.591gitlab # [ 3.868123] systemd[1]: systemd-modules-load.service: Deactivated successfully.592gitlab # [ 3.870295] systemd[1]: Stopped Load Kernel Modules.593gitlab # [ 3.871856] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.594gitlab # [ 3.874305] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.595gitlab # [ 3.876435] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.596gitlab # [ 3.878258] systemd[1]: Stopped Create System Files and Directories.597gitlab # [ 3.879837] systemd[1]: Stopped target Local File Systems.598gitlab # [ 3.881433] systemd[1]: Stopped target Preparation for Local File Systems.599gitlab # [ 3.883029] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.600gitlab # [ 3.884753] systemd[1]: Stopped Coldplug All udev Devices.601gitlab # [ 3.885998] systemd[1]: Stopping Rule-based Manager for Device Events and Files...602gitlab # [ 3.887636] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.603gitlab # [ 3.889375] systemd[1]: Stopped Virtual Console Setup.604gitlab # [ 3.890677] systemd[1]: initrd-cleanup.service: Deactivated successfully.605gitlab # [ 3.892133] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.606gitlab # [ 3.893516] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.607gitlab # [ 3.895021] systemd[1]: Finished Load Kernel Module 9pnet_virtio.608gitlab # [ 3.897391] systemd[1]: systemd-udevd.service: Deactivated successfully.609gitlab # [ 3.898769] systemd[1]: Stopped Rule-based Manager for Device Events and Files.610gitlab # [ 3.900312] systemd[1]: systemd-udevd.service: Consumed 2.184s CPU time over 2.181s wall clock time, 31.7M memory peak.611gitlab # [ 3.902429] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.612gitlab # [ 3.903916] systemd[1]: Finished rw-sysroot-nix-store.service.613gitlab # [ 3.905235] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.614gitlab # [ 3.906703] systemd[1]: Closed udev Control Socket.615gitlab # [ 3.907753] systemd[1]: Starting Cleanup udev Database...616gitlab # [ 3.908964] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.617gitlab # [ 3.910560] systemd[1]: Stopped Create Static Device Nodes in /dev.618gitlab # [ 3.912068] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.619gitlab # [ 3.913755] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.620gitlab # [ 3.915217] systemd[1]: kmod-static-nodes.service: Deactivated successfully.621gitlab # [ 3.916752] systemd[1]: Stopped Create List of Static Device Nodes.622gitlab # [ 3.981740] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.623gitlab # [ 3.984965] systemd[1]: Finished Cleanup udev Database.624gitlab # [ 3.987182] systemd[1]: Reached target Switch Root.625gitlab # [ 3.989456] systemd[1]: Starting NixOS Activation...626gitlab # [ 4.157785] initrd-nixos-activation-start[221]: booting system configuration /nix/store/2s0rff4injl4sqf27i9dxqpl36g3jl33-nixos-system-gitlab-test627gitlab # [ 4.218376] initrd-nixos-activation-start[221]: running activation script...628gitlab # [ 4.538274] initrd-nixos-activation-start[244]: setting up /etc...629gitlab # [ 4.693280] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.630gitlab # [ 4.695909] systemd[1]: Finished NixOS Activation.631gitlab # [ 4.697924] systemd[1]: Starting Switch Root...632gitlab # [ 4.747339] systemd[1]: Switching root.633gitlab # [ 4.887202] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).634gitlab # [ 5.579165] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)635gitlab # [ 5.579303] systemd[1]: Detected virtualization qemu.636gitlab # [ 5.579375] systemd[1]: Detected architecture arm64.637gitlab # [ 5.579533] systemd[1]: Detected first boot.638gitlab # [ 5.580799] systemd[1]: Initializing machine ID from random generator.639gitlab # [ 5.830545] systemd[1]: bpf-restrict-fs: LSM BPF program attached640gitlab # [ 5.949954] systemd[1]: Applying preset policy.641gitlab # [ 6.156259] systemd[1]: Populated /etc with preset unit settings.642gitlab # [ 6.301017] systemd[1]: initrd-switch-root.service: Deactivated successfully.643gitlab # [ 6.301265] systemd[1]: Stopped initrd-switch-root.service.644gitlab # [ 6.302752] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.645gitlab # [ 6.307750] systemd[1]: Created slice Slice /system/getty.646gitlab # [ 6.314039] systemd[1]: Created slice GitLab DevOps Platform Slice.647gitlab # [ 6.317468] systemd[1]: Created slice User and Session Slice.648gitlab # [ 6.318014] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.649gitlab # [ 6.319795] systemd[1]: Started Forward Password Requests to Wall Directory Watch.650gitlab # [ 6.320776] systemd[1]: Expecting device /dev/hvc0...651gitlab # [ 6.321502] systemd[1]: Expecting device /dev/ttyAMA0...652gitlab # [ 6.322206] systemd[1]: Reached target Local Encrypted Volumes.653gitlab # [ 6.323276] systemd[1]: Stopped target initrd-fs.target.654gitlab # [ 6.324376] systemd[1]: Stopped target initrd-root-fs.target.655gitlab # [ 6.325452] systemd[1]: Stopped target initrd-switch-root.target.656gitlab # [ 6.326619] systemd[1]: Reached target Virtual Machines and Containers.657gitlab # [ 6.327735] systemd[1]: Reached target Path Units.658gitlab # [ 6.328843] systemd[1]: Reached target Remote File Systems.659gitlab # [ 6.329929] systemd[1]: Reached target Slice Units.660gitlab # [ 6.331075] systemd[1]: Reached target Swaps.661gitlab # [ 6.335138] systemd[1]: Listening on Query the User Interactively for a Password.662gitlab # [ 6.339256] systemd[1]: Listening on Process Core Dump Socket.663gitlab # [ 6.342352] systemd[1]: Listening on Credential Encryption/Decryption.664gitlab # [ 6.346060] systemd[1]: Listening on Factory Reset Management.665gitlab # [ 6.347437] systemd[1]: Listening on Hostname Service Socket.666gitlab # [ 6.357642] systemd[1]: Starting Journal Log Access Socket...667gitlab # [ 6.359836] systemd[1]: Listening on Journal Audit Socket.668gitlab # [ 6.363906] systemd[1]: Listening on Console Output Muting Service Socket.669gitlab # [ 6.365460] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.670gitlab # [ 6.366567] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os671gitlab # [ 6.367572] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki672gitlab # [ 6.373714] systemd[1]: Listening on Disk Repartitioning Service Socket.673gitlab # [ 6.375097] systemd[1]: Listening on udev Control Socket.674gitlab # [ 6.376457] systemd[1]: Listening on udev Varlink Socket.675gitlab # [ 6.410587] systemd[1]: Mounting Huge Pages File System...676gitlab # [ 6.416535] systemd[1]: Mounting POSIX Message Queue File System...677gitlab # [ 6.422741] systemd[1]: Mounting Kernel Debug File System...678gitlab # [ 6.428891] systemd[1]: Mounting Kernel Trace File System...679gitlab # [ 6.438763] systemd[1]: Starting Create List of Static Device Nodes...680gitlab # [ 6.456080] systemd[1]: Starting Load Kernel Module 9pnet_virtio...681gitlab # [ 6.457464] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs682gitlab # [ 6.463775] systemd[1]: Mounting Kernel Configuration File System...683gitlab # [ 6.464885] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm684gitlab # [ 6.465904] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore685gitlab # [ 6.474748] systemd[1]: Starting Load Kernel Module fuse...686gitlab # [ 6.475960] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67687gitlab # [ 6.484647] systemd[1]: Starting Journal Service...688gitlab # [ 6.490606] systemd[1]: Starting Load Kernel Modules...689gitlab # [ 6.498799] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...690gitlab # [ 6.510630] systemd[1]: Starting Remount Root and Kernel File Systems...691gitlab # [ 6.511364] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os692gitlab # [ 6.518822] fuse: init (API version 7.45)693gitlab # [ 6.526580] systemd[1]: Starting Coldplug All udev Devices...694gitlab # [ 6.531691] systemd[1]: Listening on Journal Log Access Socket.695gitlab # [ 6.532829] systemd-journald[315]: Collecting audit messages is enabled.696gitlab # [ 6.533732] systemd[1]: Mounted Huge Pages File System.697gitlab # [ 6.538960] systemd[1]: Mounted POSIX Message Queue File System.698gitlab # [ 6.539780] systemd[1]: Mounted Kernel Debug File System.699gitlab # [ 6.540574] systemd[1]: Mounted Kernel Trace File System.700gitlab # [ 6.542936] systemd[1]: Finished Create List of Static Device Nodes.701gitlab # [ 6.544336] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.702gitlab # [ 6.545490] systemd[1]: Finished Load Kernel Module 9pnet_virtio.703gitlab # [ 6.546343] systemd[1]: Mounted Kernel Configuration File System.704gitlab # [ 6.553597] systemd[1]: Queued start job for default target Multi-User System.[ 6.547469] systemd[1]: modprobe@fuse.service: Deactivated successfully.705gitlab # 706gitlab # [ 6.548430] systemd[1]: Finished Load Kernel Module fuse.707gitlab # [ 6.549653] systemd[1]: Finished Load Kernel Modules.708gitlab # [ 6.564359] systemd[1]: Unnecessary job was removed for /dev/vdb.[ 6.558902] systemd[1]: Mounting FUSE Control File System...709gitlab # [ 6.561584] EXT4-fs (vda): re-mounted 6a8b2a0a-d7a4-438d-8a75-120d633d765b.710gitlab # 711gitlab # [ 6.572151] systemd[1]: Starting Firewall...712gitlab # [ 6.569964] systemd[1]: systemd-journald.service: Deactivated successfully.713gitlab # [ 6.573136] systemd-modules-load[316]: Using 3 probe threads714gitlab # [ 6.574242] systemd-modules-load[316]: Module 'atkbd' is built in715gitlab # [ 6.575395] systemd-modules-load[316]: Module 'loop' is built in716gitlab # [ 6.576602] systemd-modules-load[316]: Inserted module 'tls'717gitlab # [ 6.590853] systemd[1]: Starting Apply Kernel Variables...718gitlab # [ 6.597212] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...719gitlab # [ 6.600253] systemd[1]: Finished Remount Root and Kernel File Systems.720gitlab # [ 6.600504] systemd[1]: Started Journal Service.721gitlab # [ 6.603375] systemd[1]: Mounted FUSE Control File System.722gitlab # [ 6.614394] systemd-oomd[318]: No swap; memory pressure usage will be degraded723gitlab # [ 6.616254] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.724gitlab # [ 6.617330] systemd[1]: Finished Apply Kernel Variables.725gitlab # [ 6.622597] systemd[1]: Listening on Disk Image Download Service Socket.726gitlab # [ 6.626313] systemd[1]: Starting Flush Journal to Persistent Storage...727gitlab # [ 6.630107] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore728gitlab # [ 6.648985] systemd[1]: Starting Load/Save OS Random Seed...729gitlab # [ 6.649922] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os730gitlab # [ 6.653754] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.731gitlab # [ 6.659592] systemd-journald[315]: Received client request to flush runtime journal.732gitlab # [ 6.693504] systemd[1]: Starting Create Static Device Nodes in /dev...733gitlab # [ 6.696128] systemd[1]: Finished Load/Save OS Random Seed.734gitlab # [ 6.697682] systemd[1]: Reached target First Boot Complete.735gitlab # [ 6.699023] systemd[1]: Finished Create Static Device Nodes in /dev.736gitlab # [ 6.699953] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 6.701400] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 6.702485] systemd[1]: Finished Flush Journal to Persistent Storage.739gitlab # [ 6.746528] systemd-udevd[367]: Using default interface naming scheme 'v261'.740gitlab # [ 6.779805] systemd[1]: Started Rule-based Manager for Device Events and Files.741gitlab # [ 6.897325] systemd[1]: Finished Firewall.742gitlab # [ 7.165246] systemd[1]: Finished Coldplug All udev Devices.743gitlab # [ 7.241843] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs744gitlab # [ 7.312772] systemd[1]: Mounting /run/wrappers...745gitlab # [ 7.320395] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.746gitlab # [ 7.334786] (udev-worker)[473]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.747gitlab # [ 7.340196] (udev-worker)[473]: Network interface NamePolicy= disabled on kernel command line.748gitlab # [ 7.360655] systemd[1]: Mounted /run/wrappers.749gitlab # [ 7.363722] systemd[1]: Condition check resulted in Virtio network device being skipped.750gitlab # [ 7.369385] (udev-worker)[420]: Network interface NamePolicy= disabled on kernel command line.751gitlab # [ 7.372114] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.752gitlab # [ 7.374055] systemd[1]: Reached target Local File Systems.753gitlab # [ 7.375075] systemd[1]: Listening on Boot Loader Control Service Socket.754gitlab # [ 7.378928] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore755gitlab # [ 7.381429] systemd[1]: Starting register-nix-paths.service...756gitlab # [ 7.382422] systemd[1]: Starting Create SUID/SGID Wrappers...757gitlab # [ 7.383404] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.758gitlab # [ 7.384951] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67759gitlab # [ 7.387456] systemd[1]: Starting Save Transient machine-id to Disk...760gitlab # [ 7.389324] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore761gitlab # [ 7.405531] systemd[1]: Starting Create System Files and Directories...762gitlab # [ 7.410935] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os763gitlab # [ 7.417639] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os764gitlab # [ 7.435062] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.765gitlab # [ 7.439421] systemd[1]: Finished Save Transient machine-id to Disk.766gitlab # [ 7.440937] systemd[1]: Finished Create System Files and Directories.767gitlab # [ 7.446125] systemd[1]: Starting Rebuild Journal Catalog...768gitlab # [ 7.447421] systemd[1]: Starting Record System Boot/Shutdown in UTMP...769gitlab # [ 7.481256] systemd[1]: Finished Record System Boot/Shutdown in UTMP.770gitlab # [ 7.487557] systemd[1]: Finished Rebuild Journal Catalog.771gitlab # [ 7.491772] systemd[1]: Starting Update is Completed...772gitlab # [ 7.506255] systemd[1]: Finished Update is Completed.773gitlab # [ 7.510480] mousedev: PS/2 mouse device common for all mice774gitlab # [ 7.574971] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.775gitlab # [ 7.577955] systemd[1]: Finished Create SUID/SGID Wrappers.776gitlab # [ 7.579143] systemd[1]: suid-sgid-wrappers.service: Consumed 134ms CPU time over 200ms wall clock time, 6.5M memory peak, 1.9M read from disk.777gitlab # [ 7.824054] systemd[1]: Finished register-nix-paths.service.778gitlab # [ 7.826178] systemd[1]: Reached target System Initialization.779gitlab # [ 7.827049] systemd[1]: Started Discard unused filesystem blocks once a week.780gitlab # [ 7.830141] systemd[1]: Started logrotate.timer.781gitlab # [ 7.830906] systemd[1]: Started Daily Cleanup of Temporary Directories.782gitlab # [ 7.831842] systemd[1]: Reached target Timer Units.783gitlab # [ 7.832647] systemd[1]: Listening on D-Bus System Message Bus Socket.784gitlab # [ 7.833567] systemd[1]: Listening on Nix Daemon Socket.785gitlab # [ 7.843683] systemd[1]: Starting nixbot CI service socket...786gitlab # [ 7.844677] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.787gitlab # [ 7.845862] systemd[1]: Listening on nixbot CI service socket.788gitlab # [ 7.846683] systemd[1]: Reached target Socket Units.789gitlab # [ 7.848876] systemd[1]: Starting D-Bus System Message Bus...790gitlab # [ 7.880464] dbus-broker-launch[558]: Looking up NSS user entry for 'systemd-timesync'...791gitlab # [ 7.882579] dbus-broker-launch[558]: NSS returned no entry for 'systemd-timesync'792gitlab # [ 7.884344] dbus-broker-launch[558]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"793gitlab # [ 7.889745] systemd[1]: Started D-Bus System Message Bus.794gitlab # [ 7.909946] dbus-broker-launch[558]: Ready795gitlab # [ 7.910750] systemd[1]: Reached target Basic System.796gitlab # [ 7.913819] systemd[1]: Started backdoor.service.797gitlab # [ 7.914752] systemd[1]: Starting gitlab-config.service...798gitlab # [ 7.972281] systemd[1]: Starting Import lastlog data into lastlog2 database...799gitlab # connecting to host...800gitlab # [ 7.983660] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3801gitlab: Guest shell says: b'Spawning backdoor root shell...\n'802gitlab # [ 7.992249] systemd[1]: Starting Logrotate configuration check...803gitlab: connected to guest root shell804gitlab # [ 7.993906] systemd[1]: Starting Name Service Cache Daemon (nsncd)...805gitlab: (connecting took 8.45 seconds)806gitlab: (finished: waiting for the VM to finish booting, in 8.45 seconds)807gitlab # [ 8.013952] logrotate[570]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.808gitlab # [ 8.016569] logrotate[570]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf809gitlab # [ 8.018036] logrotate[570]: note: 'monthly' overrides previously specified 'weekly'810gitlab # [ 8.019200] logrotate[570]: Reading state from file: /var/lib/logrotate.status811gitlab # [ 8.020304] logrotate[570]: state file /var/lib/logrotate.status does not exist812gitlab # [ 8.021225] logrotate[570]: Allocating hash table for state file, size 64 entries813gitlab # [ 8.022177] logrotate[570]: Handling 4 logs814gitlab # [ 8.022732] logrotate[570]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed815gitlab # [ 8.024797] logrotate[570]: considering log /var/log/btmp816gitlab # [ 8.025572] logrotate[570]: Creating new state817gitlab # [ 8.026246] logrotate[570]: Now: 2026-09-08 05:54818gitlab # [ 8.026932] logrotate[570]: Last rotated at 2026-09-08 05:00819gitlab # [ 8.027730] logrotate[570]: log does not need rotating (log has already been rotated)820gitlab # [ 8.028997] logrotate[570]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed821gitlab # [ 8.031088] logrotate[570]: considering log /var/log/wtmp822gitlab # [ 8.031807] logrotate[570]: Creating new state823gitlab # [ 8.032517] logrotate[570]: Now: 2026-09-08 05:54824gitlab # [ 8.033194] logrotate[570]: Last rotated at 2026-09-08 05:00825gitlab # [ 8.033970] logrotate[570]: log does not need rotating (log has already been rotated)826gitlab # [ 8.034986] logrotate[570]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed827gitlab # [ 8.036752] logrotate[570]: switching euid from 0 to 165 and egid from 0 to 165 (pid 570)828gitlab # [ 8.037758] logrotate[570]: considering log /var/gitlab/state/log/*.log829gitlab # [ 8.038585] logrotate[570]: log /var/gitlab/state/log/*.log does not exist -- skipping830gitlab # [ 8.039579] logrotate[570]: Creating new state831gitlab # [ 8.040197] logrotate[570]: switching euid from 165 to 0 and egid from 165 to 0 (pid 570)832gitlab # [ 8.041198] logrotate[570]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed833gitlab # [ 8.042755] logrotate[570]: switching euid from 0 to 60 and egid from 0 to 60 (pid 570)834gitlab # [ 8.043741] logrotate[570]: considering log /var/log/nginx/*.log835gitlab # [ 8.044548] logrotate[570]: log /var/log/nginx/*.log does not exist -- skipping836gitlab # [ 8.045525] logrotate[570]: Creating new state837gitlab # [ 8.046116] logrotate[570]: not running postrotate script, since no logs were rotated838gitlab # [ 8.047104] logrotate[570]: switching euid from 60 to 0 and egid from 60 to 0 (pid 570)839gitlab # [ 8.049142] nsncd[571]: Sep 08 05:54:38.879 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"840gitlab # [ 8.051062] systemd[1]: Starting Post-Boot Actions...841gitlab # [ 8.063580] systemd[1]: Started Reset console on configuration changes.842gitlab # [ 8.076358] systemd[1]: Starting resolvconf update...843gitlab # [ 8.078560] systemd[1]: Started Name Service Cache Daemon (nsncd).844gitlab # [ 8.082783] systemd[1]: Finished Logrotate configuration check.845gitlab # [ 8.084291] systemd[1]: Finished Post-Boot Actions.846gitlab # [ 8.099271] systemd[1]: Finished Import lastlog data into lastlog2 database.847gitlab # [ 8.114404] systemd[1]: Reached target Host and Network Name Lookups.848gitlab # [ 8.115367] systemd[1]: Reached target User and Group Name Lookups.849gitlab # [ 8.118980] systemd[1]: Starting User Login Management...850gitlab # [ 8.124178] systemd[1]: Starting Virtual Console Setup...851gitlab # [ 8.154023] systemd[1]: Stopped target Host and Network Name Lookups.852gitlab # [ 8.155301] systemd[1]: Stopping Host and Network Name Lookups...853gitlab # [ 8.156598] systemd[1]: Stopped target User and Group Name Lookups.854gitlab # [ 8.157471] systemd[1]: Stopping User and Group Name Lookups...855gitlab # [ 8.158694] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...856gitlab # [ 8.163079] systemd[1]: nscd.service: Deactivated successfully.857gitlab # [ 8.164127] systemd[1]: Stopped Name Service Cache Daemon (nsncd).858gitlab # [ 8.165239] systemd[1]: nscd.service: Consumed 22ms CPU time over 167ms wall clock time, 7.9M memory peak, 5.8M read from disk.859gitlab # [ 8.167634] systemd-logind[621]: New seat seat0.860gitlab # [ 8.169580] systemd-logind[621]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)861gitlab # [ 8.170836] systemd-logind[621]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)862gitlab # [ 8.172131] systemd-logind[621]: Watching system buttons on /dev/input/event0 (gpio-keys)863gitlab # [ 8.173354] systemd[1]: Starting Name Service Cache Daemon (nsncd)...864gitlab # [ 8.174385] systemd[1]: Started User Login Management.865gitlab # [ 8.177437] systemd[1]: Starting linger-users.service...866gitlab # [ 8.184839] systemd-vconsole-setup[624]: Configuration of first virtual console was skipped, ignoring remaining ones.867gitlab # [ 8.196772] systemd[1]: Finished Virtual Console Setup.868gitlab # [ 8.202332] systemd[1]: Finished resolvconf update.869gitlab # [ 8.205361] systemd[1]: Reached target Preparation for Network.870gitlab # [ 8.209425] systemd[1]: Starting DHCP Client...871gitlab # [ 8.210506] nsncd[662]: Sep 08 05:54:39.068 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"872gitlab # [ 8.212903] systemd[1]: Starting Address configuration of eth1...873gitlab # [ 8.214315] systemd[1]: Starting Extra networking commands....874gitlab # [ 8.217701] systemd[1]: Started Name Service Cache Daemon (nsncd).875gitlab # [ 8.220297] systemd[1]: linger-users.service: Deactivated successfully.876gitlab # [ 8.221353] systemd[1]: Finished linger-users.service.877gitlab # [ 8.226262] systemd[1]: Reached target Host and Network Name Lookups.878gitlab # [ 8.227264] systemd[1]: Reached target User and Group Name Lookups.879gitlab # [ 8.243196] network-addresses-eth1-start[687]: adding address 192.168.1.1/24... done880gitlab # [ 8.247475] network-addresses-eth1-start[687]: adding address 2001:db8:1::1/64... done881gitlab # [ 8.254709] systemd[1]: Finished Address configuration of eth1.882gitlab # [ 8.301087] systemd[1]: Finished Extra networking commands..883gitlab # [ 8.302538] systemd[1]: Reached target Network.884gitlab # [ 8.304898] systemd[1]: Starting gitlab-workhorse.service...885gitlab # [ 8.307864] dhcpcd[707]: dhcpcd-10.3.2 starting886gitlab # [ 8.311653] systemd[1]: Starting Nginx Web Server...887gitlab # [ 8.313486] systemd[1]: Starting PostgreSQL Server...888gitlab # [ 8.315069] dhcpcd[756]: dev: loaded udev889gitlab # [ 8.318977] systemd[1]: Starting Redis Server - redis-gitlab...890gitlab # [ 8.324625] systemd[1]: Starting Permit User Sessions...891gitlab # [ 8.328234] 8021q: 802.1Q VLAN Support v1.8892gitlab # [ 8.328623] 8021q: adding VLAN 0 to HW filter on device eth1893gitlab # [ 8.337127] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.894gitlab # [ 8.359112] systemd[1]: Finished Permit User Sessions.895gitlab # [ 8.375077] cfg80211: Loading compiled-in X.509 certificates for regulatory database896gitlab # [ 8.375482] systemd[1]: Started Getty on tty1.897gitlab # [ 8.376348] systemd[1]: Reached target Login Prompts.898gitlab # [ 8.386537] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'899gitlab # [ 8.387028] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'900gitlab # [ 8.388727] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2901gitlab # [ 8.389041] cfg80211: failed to load regulatory.db902gitlab # [ 8.421998] dhcpcd[756]: eth0: waiting for carrier903gitlab # [ 8.423512] 8021q: adding VLAN 0 to HW filter on device eth0904gitlab # [ 8.423416] dhcpcd[756]: eth0: carrier acquired905gitlab # [ 8.426840] dhcpcd[756]: DUID 00:01:00:01:32:32:5f:9f:52:54:00:12:34:56906gitlab # [ 8.428082] dhcpcd[756]: eth0: IAID 00:12:34:56907gitlab # [ 8.428845] dhcpcd[756]: eth0: adding address fe80::5054:ff:fe12:3456908gitlab # [ 8.487579] nginx-pre-start[789]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok909gitlab # [ 8.489558] nginx-pre-start[789]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful910gitlab # [ 8.496197] systemd[1]: Started Nginx Web Server.911gitlab # [ 8.514033] redis-server[784]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.912gitlab # [ 8.516543] redis-server[784]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo913gitlab # [ 8.517902] redis-server[784]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=784, just started914gitlab # [ 8.519894] systemd[1]: Started Redis Server - redis-gitlab.915gitlab # [ 8.520854] redis-server[784]: Configuration loaded916gitlab # [ 8.522064] redis[784]: monotonic clock: ARM CNTVCT @ 1000 ticks/us917gitlab # [ 8.523685] redis[784]: Running mode=standalone, port=0.918gitlab # [ 8.525268] postgresql-pre-start[792]: The files belonging to this database system will be owned by user "postgres".919gitlab # [ 8.526724] postgresql-pre-start[792]: This user must also own the server process.920gitlab # [ 8.527856] postgresql-pre-start[792]: The database cluster will be initialized with locale "en_US.UTF-8".921gitlab # [ 8.529375] postgresql-pre-start[792]: The default database encoding has accordingly been set to "UTF8".922gitlab # [ 8.530833] postgresql-pre-start[792]: The default text search configuration will be set to "english".923gitlab # [ 8.532867] postgresql-pre-start[792]: Data page checksums are enabled.924gitlab # [ 8.534659] postgresql-pre-start[792]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok925gitlab # [ 8.536177] redis[784]: Server initialized926gitlab # [ 8.536952] postgresql-pre-start[792]: creating subdirectories ... ok927gitlab # [ 8.537843] postgresql-pre-start[792]: selecting dynamic shared memory implementation ... posix928gitlab # [ 8.539062] redis[784]: Ready to accept connections unix929gitlab # [ 8.540044] redis[784]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.930gitlab # [ 8.560084] postgresql-pre-start[792]: selecting default "max_connections" ... 100931gitlab # [ 8.606732] postgresql-pre-start[792]: selecting default "shared_buffers" ... 128MB932gitlab # [ 8.671713] dhcpcd[756]: eth0: soliciting a DHCP lease933gitlab # [ 8.684584] dhcpcd[756]: eth0: offered 10.0.2.15 from 10.0.2.2934gitlab # [ 8.704210] dhcpcd[756]: eth0: probing address 10.0.2.15/24935gitlab # [ 8.895884] systemd[1]: Started gitlab-workhorse.service.936gitlab # [ 9.073580] gitlab-workhorse[815]: time="2026-09-08T05:54:39Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4937gitlab # [ 9.075925] gitlab-workhorse[815]: time="2026-09-08T05:54:39Z" level=info msg="Using redis/go-redis"938gitlab # [ 9.077891] gitlab-workhorse[815]: time="2026-09-08T05:54:39Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix939gitlab # [ 9.087828] postgresql-pre-start[792]: selecting default time zone ... UTC940gitlab # [ 9.091369] postgresql-pre-start[792]: creating configuration files ... ok941gitlab # [ 9.324421] postgresql-pre-start[792]: running bootstrap script ... ok942gitlab # [ 9.973659] postgresql-pre-start[792]: performing post-bootstrap initialization ... ok943gitlab # [ 10.258245] postgresql-pre-start[792]: syncing data to disk ... ok944gitlab # [ 10.261096] postgresql-pre-start[792]: initdb: warning: enabling "trust" authentication for local connections945gitlab # [ 10.265176] postgresql-pre-start[792]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.946gitlab # [ 10.271870] postgresql-pre-start[792]: Success. You can now start the database server using:947gitlab # [ 10.275505] postgresql-pre-start[792]: pg_ctl -D /var/lib/postgresql/18 -l logfile start948gitlab # [ 10.389002] dhcpcd[756]: eth0: soliciting an IPv6 router949gitlab # [ 10.391465] dhcpcd[756]: eth0: Router Advertisement from fe80::2950gitlab # [ 10.394284] dhcpcd[756]: eth0: adding address fec0::5054:ff:fe12:3456/64951gitlab # [ 10.397161] dhcpcd[756]: eth0: adding route to fec0::/64952gitlab # [ 10.399461] dhcpcd[756]: eth0: adding default route via fe80::2953gitlab # [ 10.403465] postgres[849]: [849] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit954gitlab # [ 10.409106] postgres[849]: [849] LOG: listening on IPv6 address "::1", port 5432955gitlab # [ 10.412452] postgres[849]: [849] LOG: listening on IPv4 address "127.0.0.1", port 5432956gitlab # [ 10.415744] postgres[849]: [849] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"957gitlab # [ 10.420634] postgres[858]: [858] LOG: database system was shut down at 2026-09-08 05:54:40 GMT958gitlab # [ 10.428824] postgres[849]: [849] LOG: database system is ready to accept connections959gitlab # [ 10.433452] systemd[1]: Started PostgreSQL Server.960gitlab # [ 10.442410] systemd[1]: Starting PostgreSQL Setup Scripts...961gitlab # [ 10.868868] postgresql-setup-start[869]: CREATE DATABASE962gitlab # [ 10.913986] postgresql-setup-start[878]: CREATE ROLE963gitlab # [ 10.936059] postgresql-setup-start[881]: ALTER DATABASE964gitlab # [ 10.967092] postgresql-setup-start[886]: CREATE ROLE965gitlab # [ 10.970118] systemd[1]: Finished PostgreSQL Setup Scripts.966gitlab # [ 10.972419] systemd[1]: Reached target PostgreSQL.967gitlab # [ 10.977843] systemd[1]: Starting gitlab-postgresql.service...968gitlab # [ 11.075417] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[874]: mkdir -p /var/gitlab/state/home/.ssh: OK969gitlab # [ 11.079846] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[874]: chmod 700 /var/gitlab/state/home/.ssh: OK970gitlab # [ 11.163047] gitlab-postgresql-start[894]: CREATE DATABASE971gitlab # [ 11.181329] systemd[1]: Finished gitlab-config.service.972gitlab # [ 11.191796] systemd[1]: Started gitaly.service.973gitlab # [ 11.198396] systemd[1]: Starting gitlab-db-config.service...974gitlab # [ 11.254645] gitlab-postgresql-start[912]: CREATE EXTENSION975gitlab # [ 11.395139] gitlab-postgresql-start[918]: CREATE EXTENSION976gitlab # [ 11.399724] systemd[1]: Finished gitlab-postgresql.service.977gitlab # [ 11.816565] gitaly[910]: time="2026-09-08T05:54:42.673Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=910978gitlab # [ 11.828223] gitaly[910]: time="2026-09-08T05:54:42.674Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=910979gitlab # [ 11.829877] gitaly[910]: time="2026-09-08T05:54:42.674Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=910980gitlab # [ 11.831995] gitaly[910]: time="2026-09-08T05:54:42.674Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=910981gitlab # [ 11.833876] gitaly[910]: time="2026-09-08T05:54:42.674Z" level=info msg="Starting Gitaly" pid=910 version=982gitlab # [ 12.055116] gitaly[910]: time="2026-09-08T05:54:42.913Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=237 pid=910983gitlab # [ 12.058411] gitaly[910]: time="2026-09-08T05:54:42.913Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=910984gitlab # [ 12.061065] gitaly[910]: time="2026-09-08T05:54:42.913Z" level=info msg="finished initializing command factory" duration_ms=0 pid=910985gitlab # [ 12.063831] gitaly[910]: time="2026-09-08T05:54:42.913Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-910/git-exec-994439598.d/git pid=910986gitlab # [ 12.067166] gitaly[910]: time="2026-09-08T05:54:42.920Z" level=info msg="finished detecting git version" duration_ms=6 pid=910987gitlab # [ 12.069953] gitaly[910]: time="2026-09-08T05:54:42.920Z" level=info msg="using Git version" pid=910 version=2.53.g988gitlab # [ 12.072228] gitaly[910]: time="2026-09-08T05:54:42.920Z" level=info msg="clearing disk cache object folder" pid=910 storage=default989gitlab # [ 12.074814] gitaly[910]: time="2026-09-08T05:54:42.920Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache294756215 pid=910 storage=default990gitlab # [ 12.078951] gitaly[910]: time="2026-09-08T05:54:42.920Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache294756215 pid=910 storage=default991gitlab # [ 12.083953] gitaly[910]: time="2026-09-08T05:54:42.920Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=910992gitlab # [ 12.089623] gitaly[910]: time="2026-09-08T05:54:42.920Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=910993gitlab # [ 12.094837] gitaly[910]: time="2026-09-08T05:54:42.920Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache294756215 clear_duration_ms=0 pid=910 storage=default994gitlab # [ 12.101718] gitaly[910]: time="2026-09-08T05:54:42.939Z" level=info msg="counting repositories" pid=910995gitlab # [ 12.104948] gitaly[910]: time="2026-09-08T05:54:42.939Z" level=info msg="starting to count repositories" pid=910 storage_path=/var/gitlab/state/repositories996gitlab # [ 12.109699] gitaly[910]: time="2026-09-08T05:54:42.939Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=910 storage_path=/var/gitlab/state/repositories997gitlab # [ 12.115125] gitaly[910]: time="2026-09-08T05:54:42.939Z" level=info msg="completed counting all repositories" counting_duration=0 pid=910998gitlab # [ 12.119277] gitaly[910]: time="2026-09-08T05:54:42.939Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=910999gitlab # [ 12.124738] gitaly[910]: time="2026-09-08T05:54:42.940Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=910 schema=unix1000gitlab # [ 12.129808] gitaly[910]: time="2026-09-08T05:54:42.940Z" level=info msg="listening at address" address=/run/gitaly/gitaly-910/sock.d/intern pid=910 schema=unix1001gitlab # [ 12.134490] gitaly[910]: time="2026-09-08T05:54:42.940Z" level=info msg="finished tempdir cleaner walk" pid=910 storage=default time_ms=01002gitlab # [ 12.138656] gitaly[910]: time="2026-09-08T05:54:42.941Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9101003gitlab # [ 12.142883] gitaly[910]: time="2026-09-08T05:54:42.941Z" level=info msg="Started Gitaly" duration_ms=267 pid=9101004gitlab # [ 12.146410] gitaly[910]: time="2026-09-08T05:54:42.942Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9101005gitlab # [ 12.150483] gitaly[910]: time="2026-09-08T05:54:42.942Z" level=info msg="maintenance: daily scheduled" pid=910 scheduled="2026-09-08 12:00:00 +0000 UTC"1006gitlab # [ 12.542714] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1007gitlab # [ 12.546071] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1008gitlab # [ 12.572958] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1009gitlab # [ 13.575656] dhcpcd[756]: eth0: leased 10.0.2.15 for 86400 seconds1010gitlab # [ 13.575946] dhcpcd[756]: eth0: adding route to 10.0.2.0/241011gitlab # [ 13.576152] dhcpcd[756]: eth0: adding default route via 10.0.2.21012gitlab # [ 13.756565] systemd[1]: Started DHCP Client.1013gitlab # [ 13.760394] systemd[1]: Reached target Network is Online.1014gitlab # [ 15.590551] gitaly[910]: time="2026-09-08T05:54:46.447Z" level=info msg="License database preloaded" duration_ms=3772 pid=9101015gitlab # [ 57.740131] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: W, [2026-09-08T05:55:28.596649 #915] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1016gitlab # [ 59.118409] gitlab-workhorse[815]: time="2026-09-08T05:55:29Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1017gitlab # [ 60.788413] postgres[1431]: [1431] ERROR: relation "feature_gates" does not exist at character 5231018gitlab # [ 60.788609] postgres[1431]: [1431] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1019gitlab # [ 60.788653] postgres[1431]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1020gitlab # [ 60.788692] postgres[1431]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1021gitlab # [ 60.788743] postgres[1431]: attidentity AS identity,1022gitlab # [ 60.788781] postgres[1431]: attgenerated as attgenerated1023gitlab # [ 60.788813] postgres[1431]: FROM pg_attribute a1024gitlab # [ 60.788849] postgres[1431]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1025gitlab # [ 60.788887] postgres[1431]: LEFT JOIN pg_type t ON a.atttypid = t.oid1026gitlab # [ 60.788928] postgres[1431]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1027gitlab # [ 60.788965] postgres[1431]: WHERE a.attrelid = '"feature_gates"'::regclass1028gitlab # [ 60.789003] postgres[1431]: AND a.attnum > 0 AND NOT a.attisdropped1029gitlab # [ 60.789041] postgres[1431]: ORDER BY a.attnum1030gitlab # [ 60.789077] postgres[1431]:1031gitlab # [ 66.878981] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1491]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1032gitlab # [ 66.880479] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1491]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1033gitlab # [ 69.126436] gitlab-workhorse[815]: time="2026-09-08T05:55:39Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1034gitlab # [ 79.136264] gitlab-workhorse[815]: time="2026-09-08T05:55:49Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 89.146683] gitlab-workhorse[815]: time="2026-09-08T05:56:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1036gitlab # [ 92.495967] postgres[1585]: [1585] ERROR: relation "table_without_models" does not exist1037gitlab # [ 92.496415] postgres[1585]: [1585] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1038gitlab # [ 99.158236] gitlab-workhorse[815]: time="2026-09-08T05:56:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 109.162240] gitlab-workhorse[815]: time="2026-09-08T05:56:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 119.164148] gitlab-workhorse[815]: time="2026-09-08T05:56:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 123.283502] systemd[1]: Finished gitlab-db-config.service.1042gitlab # [ 123.289361] systemd[1]: Started gitlab-sidekiq.service.1043gitlab # [ 123.295018] systemd[1]: Starting gitlab.service...1044gitlab # [ 123.835291] bundle[1969]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1045gitlab # [ 123.841660] bundle[1969]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1046gitlab # [ 123.847548] bundle[1969]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1047gitlab # [ 128.480322] sidekiq-cluster[1968]: {"severity":"INFO","time":"2026-09-08T05:56:39.310Z","message":"Starting cluster with 1 processes"}1048gitlab # [ 128.498826] bundle[1969]: {"timestamp":"2026-09-08T05:56:39.327Z","pid":1969,"message":"* Enabling systemd notification integration"}1049gitlab # [ 128.501447] bundle[1969]: {"timestamp":"2026-09-08T05:56:39.356Z","pid":1969,"message":"Puma starting in cluster mode..."}1050gitlab # [ 128.502842] bundle[1969]: {"timestamp":"2026-09-08T05:56:39.356Z","pid":1969,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1051gitlab # [ 128.504386] bundle[1969]: {"timestamp":"2026-09-08T05:56:39.356Z","pid":1969,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1052gitlab # [ 128.506209] bundle[1969]: {"timestamp":"2026-09-08T05:56:39.356Z","pid":1969,"message":"* Min threads: 0"}1053gitlab # [ 128.507456] bundle[1969]: {"timestamp":"2026-09-08T05:56:39.356Z","pid":1969,"message":"* Max threads: 4"}1054gitlab # [ 128.508762] bundle[1969]: {"timestamp":"2026-09-08T05:56:39.356Z","pid":1969,"message":"* Environment: production"}1055gitlab # [ 128.510044] bundle[1969]: {"timestamp":"2026-09-08T05:56:39.356Z","pid":1969,"message":"* Master PID: 1969"}1056gitlab # [ 128.511274] bundle[1969]: {"timestamp":"2026-09-08T05:56:39.356Z","pid":1969,"message":"* Workers: 2"}1057gitlab # [ 128.512509] bundle[1969]: {"timestamp":"2026-09-08T05:56:39.357Z","pid":1969,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1058gitlab # [ 128.514030] bundle[1969]: {"timestamp":"2026-09-08T05:56:39.357Z","pid":1969,"message":"* Preloading application"}1059gitlab # [ 129.168282] gitlab-workhorse[815]: time="2026-09-08T05:56:40Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1060gitlab # [ 139.171146] gitlab-workhorse[815]: time="2026-09-08T05:56:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1061gitlab # [ 149.181436] gitlab-workhorse[815]: time="2026-09-08T05:57:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1062gitlab # [ 159.190445] gitlab-workhorse[815]: time="2026-09-08T05:57:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 166.441119] bundle[1969]: W, [2026-09-08T05:57:17.298032 #1969] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1064gitlab # [ 169.200464] gitlab-workhorse[815]: time="2026-09-08T05:57:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 171.506695] sidekiq-cluster[2017]: 2026-09-08T05:57:22.363Z pid=2017 tid=wnd INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2017, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433299456}1066gitlab # [ 171.800131] sidekiq-cluster[2017]: W, [2026-09-08T05:57:22.658122 #2017] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1067gitlab # [ 171.869566] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:22.727Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1068gitlab # [ 175.805516] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.662Z","message":"GitLab reliable fetch activated!"}1069gitlab # [ 175.805920] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.662Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1070gitlab # [ 175.853820] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.711Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1071gitlab # [ 175.860377] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.718Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1072gitlab # [ 175.867096] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.725Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1073gitlab # [ 175.874187] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.732Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1074gitlab # [ 175.880357] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.738Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1075gitlab # [ 175.886724] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.744Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1076gitlab # [ 175.891779] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.749Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1077gitlab # [ 175.895513] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.753Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1078gitlab # [ 175.898898] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.757Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1079gitlab # [ 175.902276] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.760Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1080gitlab # [ 175.905756] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.763Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1081gitlab # [ 175.909182] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.767Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1082gitlab # [ 175.912218] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.770Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1083gitlab # [ 175.915281] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.773Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1084gitlab # [ 175.918434] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.776Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1085gitlab # [ 175.921435] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.779Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1086gitlab # [ 175.925233] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.783Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1087gitlab # [ 175.929373] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.787Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1088gitlab # [ 175.932942] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.791Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1089gitlab # [ 175.936489] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.794Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1090gitlab # [ 175.939931] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.798Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1091gitlab # [ 175.943500] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.801Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1092gitlab # [ 175.947208] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.805Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1093gitlab # [ 175.950036] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.808Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1094gitlab # [ 175.953287] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.811Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1095gitlab # [ 175.956811] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.814Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1096gitlab # [ 175.960119] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.818Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1097gitlab # [ 175.963601] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.821Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1098gitlab # [ 175.967733] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.825Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1099gitlab # [ 175.971178] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.829Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1100gitlab # [ 175.973841] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.832Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1101gitlab # [ 175.977013] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.835Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1102gitlab # [ 175.979842] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.838Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1103gitlab # [ 175.982974] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.841Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1104gitlab # [ 175.985998] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.844Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1105gitlab # [ 175.988606] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.846Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1106gitlab # [ 175.991141] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.848Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1107gitlab # [ 175.993613] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.851Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1108gitlab # [ 175.995968] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.854Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1109gitlab # [ 175.998386] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.856Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1110gitlab # [ 176.000799] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.858Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1111gitlab # [ 176.003084] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.860Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1112gitlab # [ 176.005466] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.863Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1113gitlab # [ 176.007612] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.865Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1114gitlab # [ 176.010055] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.868Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1115gitlab # [ 176.012386] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.870Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1116gitlab # [ 176.014543] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.872Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1117gitlab # [ 176.016698] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.874Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1118gitlab # [ 176.018745] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.876Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1119gitlab # [ 176.020883] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.878Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1120gitlab # [ 176.022945] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.880Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1121gitlab # [ 176.025416] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.883Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1122gitlab # [ 176.038129] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.896Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1123gitlab # [ 176.041125] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.899Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1124gitlab # [ 176.043640] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.901Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1125gitlab # [ 176.046131] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.904Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1126gitlab # [ 176.048421] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.906Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1127gitlab # [ 176.050919] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.909Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1128gitlab # [ 176.053161] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.911Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1129gitlab # [ 176.055684] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.913Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1130gitlab # [ 176.057760] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.915Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1131gitlab # [ 176.059708] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.917Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1132gitlab # [ 176.061886] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.920Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1133gitlab # [ 176.064289] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.922Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1134gitlab # [ 176.072920] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.930Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1135gitlab # [ 176.079278] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.937Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1136gitlab # [ 176.084008] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.942Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1137gitlab # [ 176.089577] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.947Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1138gitlab # [ 176.097028] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.955Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1139gitlab # [ 176.101466] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.959Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1140gitlab # [ 176.105643] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.963Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1141gitlab # [ 176.110981] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.968Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1142gitlab # [ 176.114686] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.972Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1143gitlab # [ 176.122364] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.974Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1144gitlab # [ 176.129242] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.976Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1145gitlab # [ 176.135376] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.977Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1146gitlab # [ 176.140702] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.979Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1147gitlab # [ 176.145942] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.981Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1148gitlab # [ 176.150299] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.982Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1149gitlab # [ 176.154306] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.984Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1150gitlab # [ 176.158452] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.985Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1151gitlab # [ 176.162493] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.986Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1152gitlab # [ 176.166192] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.989Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1153gitlab # [ 176.169565] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.991Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1154gitlab # [ 176.172988] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.992Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1155gitlab # [ 176.176053] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.994Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1156gitlab # [ 176.179141] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.996Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1157gitlab # [ 176.182170] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.997Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1158gitlab # [ 176.185083] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:26.999Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1159gitlab # [ 176.187813] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.000Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1160gitlab # [ 176.190668] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.002Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1161gitlab # [ 176.193287] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.003Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1162gitlab # [ 176.195874] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.005Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1163gitlab # [ 176.198821] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.006Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1164gitlab # [ 176.201074] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.008Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1165gitlab # [ 176.203621] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.011Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1166gitlab # [ 176.206254] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.012Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1167gitlab # [ 176.208706] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.014Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1168gitlab # [ 176.211043] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.027Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1169gitlab # [ 176.213390] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.029Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1170gitlab # [ 176.215590] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.031Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1171gitlab # [ 176.217959] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.033Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1172gitlab # [ 176.219991] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.036Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1173gitlab # [ 176.222286] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.038Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1174gitlab # [ 176.224652] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.041Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1175gitlab # [ 176.227057] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.042Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1176gitlab # [ 176.230923] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.089Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1177gitlab # [ 176.234299] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.092Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1178gitlab # [ 176.236932] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:57:27.094Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1179gitlab # [ 179.203486] gitlab-workhorse[815]: time="2026-09-08T05:57:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1180gitlab # [ 189.210436] gitlab-workhorse[815]: time="2026-09-08T05:57:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1181gitlab # [ 199.220390] gitlab-workhorse[815]: time="2026-09-08T05:57:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1182gitlab # [ 209.230282] gitlab-workhorse[815]: time="2026-09-08T05:58:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 216.410577] postgres[2755]: [2755] ERROR: relation "table_without_models" does not exist1184gitlab # [ 216.410963] postgres[2755]: [2755] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1185gitlab # [ 218.474863] postgres[2775]: [2775] ERROR: relation "table_without_models" does not exist1186gitlab # [ 218.478460] postgres[2775]: [2775] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1187gitlab # [ 219.238421] gitlab-workhorse[815]: time="2026-09-08T05:58:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 221.403474] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:12.260Z","message":"Booted Rails 7.2.3.1 application in production environment"}1189gitlab # [ 221.406316] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:12.264Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1190gitlab # [ 221.406479] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:12.264Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1191gitlab # [ 221.406527] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:12.264Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1192gitlab # [ 221.412135] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:12.266Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1193gitlab # [ 224.144320] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:15.001Z","message":"Cleaning working queues"}1194gitlab # [ 224.147007] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:15.004Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"45fc466fa8e699b5947e0c04","created_at":"2026-09-08T05:56:33.486Z","trace_propagation_headers":{"sentry-trace":"41ed3055f77e4e3a8c232e9aabe62d95-5ed2c2f96fc44e85","baggage":"sentry-trace_id=41ed3055f77e4e3a8c232e9aabe62d95,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"a94cdffbda48e7f904483d49f30f3f42","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:33.497Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-45fc466fa8e699b5947e0c04: start","job_status":"start","queue_duration_s":101.506499,"scheduling_latency_s":101.506605}1195gitlab # [ 224.189340] bundle[1969]: {"timestamp":"2026-09-08T05:58:15.046Z","pid":1969,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1196gitlab # [ 224.192241] bundle[1969]: {"timestamp":"2026-09-08T05:58:15.047Z","pid":1969,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1197gitlab # [ 224.194955] bundle[1969]: {"timestamp":"2026-09-08T05:58:15.047Z","pid":1969,"message":"! #\u003cThread:0x0000f167dc319440 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1198gitlab # [ 224.203072] bundle[1969]: {"timestamp":"2026-09-08T05:58:15.047Z","pid":1969,"message":"! #\u003cThread:0x0000f167dc559020 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1199gitlab # [ 224.210882] bundle[1969]: {"timestamp":"2026-09-08T05:58:15.047Z","pid":1969,"message":"Use Ctrl-C to stop"}1200gitlab # [ 224.212712] bundle[1969]: {"timestamp":"2026-09-08T05:58:15.048Z","pid":1969,"message":"Sending status to systemd every 1.0 sec"}1201gitlab # [ 224.454686] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:15.311Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"45fc466fa8e699b5947e0c04","created_at":"2026-09-08T05:56:33.486Z","trace_propagation_headers":{"sentry-trace":"41ed3055f77e4e3a8c232e9aabe62d95-5ed2c2f96fc44e85","baggage":"sentry-trace_id=41ed3055f77e4e3a8c232e9aabe62d95,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"a94cdffbda48e7f904483d49f30f3f42","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:33.497Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-45fc466fa8e699b5947e0c04: done: 0.307432 sec","job_status":"done","queue_duration_s":101.506499,"scheduling_latency_s":101.506605,"redis_calls":24,"redis_duration_s":0.007289,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.003477,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002404,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001408,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.146776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1807062,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.307432,"completed_at":"2026-09-08T05:58:15.311Z","load_balancing_strategy":"primary","db_duration_s":0.095129,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1202gitlab # [ 224.786844] bundle[1969]: {"timestamp":"2026-09-08T05:58:15.644Z","pid":1969,"message":"- Worker 0 (PID: 2887) booted in 0.54s, phase: 0"}1203gitlab # [ 224.792565] bundle[1969]: {"timestamp":"2026-09-08T05:58:15.650Z","pid":1969,"message":"- Worker 1 (PID: 2891) booted in 0.52s, phase: 0"}1204gitlab # [ 224.798418] systemd[1]: Started gitlab.service.1205gitlab # [ 224.800596] systemd[1]: Reached target Common target for all GitLab services..1206gitlab # [ 224.803635] systemd[1]: Starting setup-gitlab.service...1207gitlab # [ 224.835828] setup-gitlab-start[2916]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1208gitlab # [ 228.489983] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:19 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 36101209gitlab # [ 228.496476] setup-gitlab-start[2916]: + TOKEN=nixbot-test-token-of-20-chars1210gitlab # [ 228.499680] setup-gitlab-start[2916]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1211gitlab # [ 228.516127] runuser[2943]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1212gitlab # [ 229.081769] setup-gitlab-start[2944]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1213gitlab # [ 229.088352] setup-gitlab-start[2944]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1214gitlab # [ 229.094626] setup-gitlab-start[2944]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1215gitlab # [ 229.907423] setup-gitlab-start[2944]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1216gitlab # [ 229.907963] setup-gitlab-start[2944]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1217gitlab # [ 229.910205] setup-gitlab-start[2944]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1218gitlab # [ 235.378149] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:26.234Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e0224edc248a7c7ecadd6f8f","created_at":"2026-09-08T05:58:26.123Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d75304e07cff6d4a7a8d0b603c1ccef","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.229Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e0224edc248a7c7ecadd6f8f: start","job_status":"start","queue_duration_s":0.004481,"scheduling_latency_s":0.004545}1219gitlab # [ 235.591191] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:26.448Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e0224edc248a7c7ecadd6f8f","created_at":"2026-09-08T05:58:26.123Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d75304e07cff6d4a7a8d0b603c1ccef","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.229Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e0224edc248a7c7ecadd6f8f: done: 0.214393 sec","job_status":"done","queue_duration_s":0.004481,"scheduling_latency_s":0.004545,"redis_calls":12,"redis_duration_s":0.020659,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.013304,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004218,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003137,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00224822,"exclusive_lock_hold_duration_s":0.0429325,"duration_s":0.214393,"completed_at":"2026-09-08T05:58:26.448Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.05854,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1220gitlab # [ 235.677129] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:26.451Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"698b28a6974f8a016678675e","created_at":"2026-09-08T05:58:26.278Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0dfe0b1a337140d5ce805f04284c38c7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.298Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-698b28a6974f8a016678675e: start","job_status":"start","queue_duration_s":0.152724,"scheduling_latency_s":0.152753}1221gitlab # [ 235.781392] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:26.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"698b28a6974f8a016678675e","created_at":"2026-09-08T05:58:26.278Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0dfe0b1a337140d5ce805f04284c38c7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.298Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-698b28a6974f8a016678675e: done: 0.186852 sec","job_status":"done","queue_duration_s":0.152724,"scheduling_latency_s":0.152753,"redis_calls":13,"redis_duration_s":0.013078000000000001,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00053,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.009577,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002971,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.067,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.067,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07108714000000001,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.186852,"completed_at":"2026-09-08T05:58:26.637Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.067107,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1222gitlab # [ 235.876473] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:26.657Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"45f8710ab96098415a034063","created_at":"2026-09-08T05:58:26.335Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80ca42093b5801431cf7863b3bd52802","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.347Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-45f8710ab96098415a034063: start","job_status":"start","queue_duration_s":0.309726,"scheduling_latency_s":0.309774}1223gitlab # [ 236.209168] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"45f8710ab96098415a034063","created_at":"2026-09-08T05:58:26.335Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80ca42093b5801431cf7863b3bd52802","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.347Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-45f8710ab96098415a034063: done: 0.40822 sec","job_status":"done","queue_duration_s":0.309726,"scheduling_latency_s":0.309774,"redis_calls":14,"redis_duration_s":0.072036,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.018155,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.042225,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.011656,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.041,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.125954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00314178,"exclusive_lock_hold_duration_s":0.22593222,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.40822,"completed_at":"2026-09-08T05:58:27.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.057642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 236.301901] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.070Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"fbef335c0f2c827cdbe876c0","created_at":"2026-09-08T05:58:26.361Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d4a3688465dffe31fb0757ce0b627a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.375Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-fbef335c0f2c827cdbe876c0: start","job_status":"start","queue_duration_s":0.694602,"scheduling_latency_s":0.694649}1225gitlab # [ 236.375543] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.232Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"fbef335c0f2c827cdbe876c0","created_at":"2026-09-08T05:58:26.361Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d4a3688465dffe31fb0757ce0b627a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.375Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-fbef335c0f2c827cdbe876c0: done: 0.162107 sec","job_status":"done","queue_duration_s":0.694602,"scheduling_latency_s":0.694649,"redis_calls":12,"redis_duration_s":0.004369,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000677,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00172,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0012418,"exclusive_lock_hold_duration_s":0.06474272,"duration_s":0.162107,"completed_at":"2026-09-08T05:58:27.232Z","load_balancing_strategy":"primary","db_duration_s":0.054236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 236.458991] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"06802a3a9a3cc4d3b7eb324a","created_at":"2026-09-08T05:58:26.393Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f93d5516dd258f5ee3bbcf941828d2b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.415Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-06802a3a9a3cc4d3b7eb324a: start","job_status":"start","queue_duration_s":0.826546,"scheduling_latency_s":0.826593}1227gitlab # [ 236.480093] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"06802a3a9a3cc4d3b7eb324a","created_at":"2026-09-08T05:58:26.393Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f93d5516dd258f5ee3bbcf941828d2b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.415Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-06802a3a9a3cc4d3b7eb324a: done: 0.095236 sec","job_status":"done","queue_duration_s":0.826546,"scheduling_latency_s":0.826593,"redis_calls":10,"redis_duration_s":0.004801,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000859,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002859,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00095124,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.095236,"completed_at":"2026-09-08T05:58:27.337Z","load_balancing_strategy":"primary","db_duration_s":0.032746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 236.533809] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.341Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"f3ad7e8accd244e49f0f2da9","created_at":"2026-09-08T05:58:26.428Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba22bf05d94cae1b4b09fb6bce18530e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.453Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-f3ad7e8accd244e49f0f2da9: start","job_status":"start","queue_duration_s":0.887351,"scheduling_latency_s":0.887399}1229gitlab # [ 236.550826] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.369Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1230gitlab # [ 236.554993] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.385Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"f3ad7e8accd244e49f0f2da9","created_at":"2026-09-08T05:58:26.428Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba22bf05d94cae1b4b09fb6bce18530e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.453Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-f3ad7e8accd244e49f0f2da9: done: 0.044557 sec","job_status":"done","queue_duration_s":0.887351,"scheduling_latency_s":0.887399,"redis_calls":10,"redis_duration_s":0.0035529999999999997,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000787,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002022,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000744,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057106,"duration_s":0.044557,"completed_at":"2026-09-08T05:58:27.385Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 236.602268] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.387Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b8cf21264bf3c8d96d64012c","created_at":"2026-09-08T05:58:26.476Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67eaab51604186edfa113029b2f29a11","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.490Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b8cf21264bf3c8d96d64012c: start","job_status":"start","queue_duration_s":0.896819,"scheduling_latency_s":0.89685}1232gitlab # [ 236.634769] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b8cf21264bf3c8d96d64012c","created_at":"2026-09-08T05:58:26.476Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67eaab51604186edfa113029b2f29a11","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.490Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b8cf21264bf3c8d96d64012c: done: 0.1045 sec","job_status":"done","queue_duration_s":0.896819,"scheduling_latency_s":0.89685,"redis_calls":12,"redis_duration_s":0.004171,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000677,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001759,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00140632,"exclusive_lock_hold_duration_s":0.04091396,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.1045,"completed_at":"2026-09-08T05:58:27.491Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046717,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 236.680934] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.494Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"59c6bbff0a63ec5043dbf1e4","created_at":"2026-09-08T05:58:26.501Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9e1b12fddf7cbec4c46e6f52e1170dc","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.517Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-59c6bbff0a63ec5043dbf1e4: start","job_status":"start","queue_duration_s":0.977274,"scheduling_latency_s":0.97731}1234gitlab # [ 236.694000] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.525Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"59c6bbff0a63ec5043dbf1e4","created_at":"2026-09-08T05:58:26.501Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9e1b12fddf7cbec4c46e6f52e1170dc","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.517Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-59c6bbff0a63ec5043dbf1e4: done: 0.031209 sec","job_status":"done","queue_duration_s":0.977274,"scheduling_latency_s":0.97731,"redis_calls":12,"redis_duration_s":0.00246,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000533,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000415,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000432,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003207,"duration_s":0.031209,"completed_at":"2026-09-08T05:58:27.525Z","load_balancing_strategy":"primary","db_duration_s":0.00049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 236.737508] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"b500d3bae999c3fb571bc414","created_at":"2026-09-08T05:58:26.582Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d536314459834a89937d54bf7530236","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.602Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-b500d3bae999c3fb571bc414: start","job_status":"start","queue_duration_s":0.925228,"scheduling_latency_s":0.925251}1236gitlab # [ 236.752087] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.558Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"b500d3bae999c3fb571bc414","created_at":"2026-09-08T05:58:26.582Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d536314459834a89937d54bf7530236","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.602Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-b500d3bae999c3fb571bc414: done: 0.031406 sec","job_status":"done","queue_duration_s":0.925228,"scheduling_latency_s":0.925251,"redis_calls":10,"redis_duration_s":0.001594,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000354,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024962,"duration_s":0.031406,"completed_at":"2026-09-08T05:58:27.558Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 236.794288] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1d197dfe190a39682ef72af5","created_at":"2026-09-08T05:58:26.630Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e19b446aeb8e152a56ca84666054d301","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.647Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1d197dfe190a39682ef72af5: start","job_status":"start","queue_duration_s":0.912298,"scheduling_latency_s":0.912315}1238gitlab # [ 236.809157] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.571Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1239gitlab # [ 236.812499] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.587Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1d197dfe190a39682ef72af5","created_at":"2026-09-08T05:58:26.630Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e19b446aeb8e152a56ca84666054d301","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.647Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1d197dfe190a39682ef72af5: done: 0.02755 sec","job_status":"done","queue_duration_s":0.912298,"scheduling_latency_s":0.912315,"redis_calls":10,"redis_duration_s":0.001446,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000339,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029416,"duration_s":0.02755,"completed_at":"2026-09-08T05:58:27.587Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1240gitlab # [ 236.855404] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.597Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4ffdef70839db3e0691d41db","created_at":"2026-09-08T05:58:26.656Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"956577801943a8db05f2611be00ccb2c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.670Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4ffdef70839db3e0691d41db: start","job_status":"start","queue_duration_s":0.926443,"scheduling_latency_s":0.926462}1241gitlab # [ 236.870035] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.631Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4ffdef70839db3e0691d41db","created_at":"2026-09-08T05:58:26.656Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"956577801943a8db05f2611be00ccb2c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.670Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4ffdef70839db3e0691d41db: done: 0.034441 sec","job_status":"done","queue_duration_s":0.926443,"scheduling_latency_s":0.926462,"redis_calls":16,"redis_duration_s":0.002187,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001108,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023246,"duration_s":0.034441,"completed_at":"2026-09-08T05:58:27.631Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1242gitlab # [ 236.912114] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:27.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4c3b24b1e86c28ee1ffacf8c","created_at":"2026-09-08T05:58:26.675Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62559a1269c69a3981a05efb3000700e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.686Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4c3b24b1e86c28ee1ffacf8c: start","job_status":"start","queue_duration_s":0.947141,"scheduling_latency_s":0.947159}1243gitlab # [ 237.494436] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.348Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4c3b24b1e86c28ee1ffacf8c","created_at":"2026-09-08T05:58:26.675Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62559a1269c69a3981a05efb3000700e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.686Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4c3b24b1e86c28ee1ffacf8c: done: 0.715595 sec","job_status":"done","queue_duration_s":0.947141,"scheduling_latency_s":0.947159,"redis_calls":565,"redis_duration_s":0.153439,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001526,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.151644,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.627457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068694,"duration_s":0.715595,"completed_at":"2026-09-08T05:58:28.348Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 237.591660] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"96930a05ce6bd732003aed48","created_at":"2026-09-08T05:58:26.693Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"309f6ce1b7bafde8b92699ec9662f773","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.716Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-96930a05ce6bd732003aed48: start","job_status":"start","queue_duration_s":1.635478,"scheduling_latency_s":1.635507}1245gitlab # [ 237.611418] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.380Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1246gitlab # [ 237.616046] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.398Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"96930a05ce6bd732003aed48","created_at":"2026-09-08T05:58:26.693Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"309f6ce1b7bafde8b92699ec9662f773","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.716Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-96930a05ce6bd732003aed48: done: 0.045979 sec","job_status":"done","queue_duration_s":1.635478,"scheduling_latency_s":1.635507,"redis_calls":10,"redis_duration_s":0.004484,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000731,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00089694,"duration_s":0.045979,"completed_at":"2026-09-08T05:58:28.398Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 237.671182] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.401Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5ac044d9b2dacddbe16f1ad6","created_at":"2026-09-08T05:58:26.731Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73f004fa260d149292523028efc3eedf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.742Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5ac044d9b2dacddbe16f1ad6: start","job_status":"start","queue_duration_s":1.658918,"scheduling_latency_s":1.659002}1248gitlab # [ 237.685962] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5ac044d9b2dacddbe16f1ad6","created_at":"2026-09-08T05:58:26.731Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73f004fa260d149292523028efc3eedf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.742Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5ac044d9b2dacddbe16f1ad6: done: 0.092032 sec","job_status":"done","queue_duration_s":1.658918,"scheduling_latency_s":1.659002,"redis_calls":19,"redis_duration_s":0.008563,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001864,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000797,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004477,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001425,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007862,"duration_s":0.092032,"completed_at":"2026-09-08T05:58:28.493Z","load_balancing_strategy":"primary","db_duration_s":0.003863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249gitlab # [ 237.728861] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.496Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"32591aaa2db298b5c09ae75b","created_at":"2026-09-08T05:58:26.748Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"895b192b955bb26d51198a46bdd24338","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.762Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-32591aaa2db298b5c09ae75b: start","job_status":"start","queue_duration_s":1.734843,"scheduling_latency_s":1.734872}1250gitlab # [ 237.743443] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.554Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"32591aaa2db298b5c09ae75b","created_at":"2026-09-08T05:58:26.748Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"895b192b955bb26d51198a46bdd24338","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.762Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-32591aaa2db298b5c09ae75b: done: 0.057876 sec","job_status":"done","queue_duration_s":1.734843,"scheduling_latency_s":1.734872,"redis_calls":12,"redis_duration_s":0.004034,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001568,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001991,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00088016,"duration_s":0.057876,"completed_at":"2026-09-08T05:58:28.554Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001468,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 237.786382] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"23248df32eb2edc93c67b9ff","created_at":"2026-09-08T05:58:26.782Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e048d9649702b33b2207b6cb40a49796","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T05:58:26.827Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-23248df32eb2edc93c67b9ff: start","job_status":"start","queue_duration_s":1.729816,"scheduling_latency_s":1.729867}1252gitlab # [ 237.800229] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.585Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1253gitlab # [ 237.804373] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"23248df32eb2edc93c67b9ff","created_at":"2026-09-08T05:58:26.782Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e048d9649702b33b2207b6cb40a49796","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T05:58:26.827Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-23248df32eb2edc93c67b9ff: done: 0.047509 sec","job_status":"done","queue_duration_s":1.729816,"scheduling_latency_s":1.729867,"redis_calls":10,"redis_duration_s":0.00316,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000594,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001909,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000657,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066464,"duration_s":0.047509,"completed_at":"2026-09-08T05:58:28.604Z","load_balancing_strategy":"primary","db_duration_s":0.000663,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 237.845703] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"acd1ca8336d8f8e8a59d24aa","created_at":"2026-09-08T05:58:26.846Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57e2c05ab1d91b732c707cfda03ac399","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.857Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-acd1ca8336d8f8e8a59d24aa: start","job_status":"start","queue_duration_s":1.75043,"scheduling_latency_s":1.750451}1255gitlab # [ 237.860210] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.637Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1256gitlab # [ 237.863626] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.656Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"acd1ca8336d8f8e8a59d24aa","created_at":"2026-09-08T05:58:26.846Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57e2c05ab1d91b732c707cfda03ac399","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.857Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-acd1ca8336d8f8e8a59d24aa: done: 0.048751 sec","job_status":"done","queue_duration_s":1.75043,"scheduling_latency_s":1.750451,"redis_calls":10,"redis_duration_s":0.0030299999999999997,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000556,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062194,"duration_s":0.048751,"completed_at":"2026-09-08T05:58:28.656Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000707,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 237.906435] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.659Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c514b313c53dc9d34d219bd0","created_at":"2026-09-08T05:58:26.866Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0acd7a62802dfe464b7d404ec3f31ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T05:58:26.875Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c514b313c53dc9d34d219bd0: start","job_status":"start","queue_duration_s":1.784078,"scheduling_latency_s":1.7841}1258gitlab # [ 237.919465] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.726Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c514b313c53dc9d34d219bd0","created_at":"2026-09-08T05:58:26.866Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0acd7a62802dfe464b7d404ec3f31ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T05:58:26.875Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c514b313c53dc9d34d219bd0: done: 0.067579 sec","job_status":"done","queue_duration_s":1.784078,"scheduling_latency_s":1.7841,"redis_calls":10,"redis_duration_s":0.00263,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00076436,"duration_s":0.067579,"completed_at":"2026-09-08T05:58:28.726Z","load_balancing_strategy":"primary","db_duration_s":0.005223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1259gitlab # [ 237.960588] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:28.729Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"12e57c3893b7bb9c93dbbc52","created_at":"2026-09-08T05:58:26.888Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4defa4801af79a7d8963a9fa7b16310","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.895Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-12e57c3893b7bb9c93dbbc52: start","job_status":"start","queue_duration_s":1.833325,"scheduling_latency_s":1.83341}1260gitlab # [ 238.407442] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"12e57c3893b7bb9c93dbbc52","created_at":"2026-09-08T05:58:26.888Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4defa4801af79a7d8963a9fa7b16310","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.895Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-12e57c3893b7bb9c93dbbc52: done: 0.534998 sec","job_status":"done","queue_duration_s":1.833325,"scheduling_latency_s":1.83341,"redis_calls":14,"redis_duration_s":0.005143,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000957,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002258,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001928,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.078,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.078,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.429177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00137498,"exclusive_lock_hold_duration_s":0.48183114,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.534998,"completed_at":"2026-09-08T05:58:29.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.116988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1261gitlab # [ 238.505612] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"12a26ed0ca95605247e75e96","created_at":"2026-09-08T05:58:26.903Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccac7947e71df3a1394e1c45dd033db0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.910Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-12a26ed0ca95605247e75e96: start","job_status":"start","queue_duration_s":2.357138,"scheduling_latency_s":2.35716}1262gitlab # [ 238.524192] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.328Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"12a26ed0ca95605247e75e96","created_at":"2026-09-08T05:58:26.903Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccac7947e71df3a1394e1c45dd033db0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.910Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-12a26ed0ca95605247e75e96: done: 0.060012 sec","job_status":"done","queue_duration_s":2.357138,"scheduling_latency_s":2.35716,"redis_calls":10,"redis_duration_s":0.004457,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000992,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000838,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066572,"duration_s":0.060012,"completed_at":"2026-09-08T05:58:29.327Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01019,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 238.575696] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1d295ae6de631dd0a7fbedfe","created_at":"2026-09-08T05:58:26.947Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.959Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1d295ae6de631dd0a7fbedfe: start","job_status":"start","queue_duration_s":2.37254,"scheduling_latency_s":2.372565}1264gitlab # [ 238.718684] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1d295ae6de631dd0a7fbedfe","created_at":"2026-09-08T05:58:26.947Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:26.959Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1d295ae6de631dd0a7fbedfe: done: 0.243787 sec","job_status":"done","queue_duration_s":2.37254,"scheduling_latency_s":2.372565,"redis_calls":71,"redis_duration_s":0.032402,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.004615,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.002265,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.024238,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.205586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070474,"duration_s":0.243787,"completed_at":"2026-09-08T05:58:29.575Z","load_balancing_strategy":"primary","db_duration_s":0.006482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265gitlab # [ 238.811117] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.578Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d3009b7a11ecd74aa513336a","created_at":"2026-09-08T05:58:26.978Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcfb92e4fb52a03adb9995ee7dec6a90","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:27.003Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d3009b7a11ecd74aa513336a: start","job_status":"start","queue_duration_s":2.57483,"scheduling_latency_s":2.574857}1266gitlab # [ 238.828623] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.629Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d3009b7a11ecd74aa513336a","created_at":"2026-09-08T05:58:26.978Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcfb92e4fb52a03adb9995ee7dec6a90","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:27.003Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d3009b7a11ecd74aa513336a: done: 0.0516 sec","job_status":"done","queue_duration_s":2.57483,"scheduling_latency_s":2.574857,"redis_calls":12,"redis_duration_s":0.007395,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000844,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003874,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002677,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00120808,"exclusive_lock_hold_duration_s":0.00617762,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.0516,"completed_at":"2026-09-08T05:58:29.629Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 238.872799] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.632Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"87a21634c70e4ba0cd51bd5a","created_at":"2026-09-08T05:58:27.034Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9618944685c5f79189415f098ef4603","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:27.057Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-87a21634c70e4ba0cd51bd5a: start","job_status":"start","queue_duration_s":2.575012,"scheduling_latency_s":2.575033}1268gitlab # [ 238.887488] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"87a21634c70e4ba0cd51bd5a","created_at":"2026-09-08T05:58:27.034Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9618944685c5f79189415f098ef4603","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:27.057Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-87a21634c70e4ba0cd51bd5a: done: 0.036757 sec","job_status":"done","queue_duration_s":2.575012,"scheduling_latency_s":2.575033,"redis_calls":10,"redis_duration_s":0.004015,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002272,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000714,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035622,"duration_s":0.036757,"completed_at":"2026-09-08T05:58:29.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 238.931278] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d70119cccce70e572fe4f9c0","created_at":"2026-09-08T05:58:27.101Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"865be330f3e6cb8803f42c1a5cc64a21","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T05:58:27.111Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d70119cccce70e572fe4f9c0: start","job_status":"start","queue_duration_s":2.559566,"scheduling_latency_s":2.559583}1270gitlab # [ 238.944792] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.693Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1271gitlab # [ 238.948470] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.708Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d70119cccce70e572fe4f9c0","created_at":"2026-09-08T05:58:27.101Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"865be330f3e6cb8803f42c1a5cc64a21","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T05:58:27.111Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d70119cccce70e572fe4f9c0: done: 0.037516 sec","job_status":"done","queue_duration_s":2.559566,"scheduling_latency_s":2.559583,"redis_calls":10,"redis_duration_s":0.004816,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001065,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002944,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066392,"duration_s":0.037516,"completed_at":"2026-09-08T05:58:29.708Z","load_balancing_strategy":"primary","db_duration_s":0.000672,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272gitlab # [ 238.989791] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.712Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9310e8d2403d90963050c2b5","created_at":"2026-09-08T05:58:28.439Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-476541b0d6a9496e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"73f004fa260d149292523028efc3eedf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:28.472Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9310e8d2403d90963050c2b5: start","job_status":"start","queue_duration_s":1.240006,"scheduling_latency_s":1.240063}1273gitlab # [ 239.002352] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.743Z","message":"No existing merge request to be cleaned up."}1274gitlab # [ 239.004078] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.766Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9310e8d2403d90963050c2b5","created_at":"2026-09-08T05:58:28.439Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-476541b0d6a9496e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"73f004fa260d149292523028efc3eedf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:28.472Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9310e8d2403d90963050c2b5: done: 0.053569 sec","job_status":"done","queue_duration_s":1.240006,"scheduling_latency_s":1.240063,"redis_calls":13,"redis_duration_s":0.0055049999999999995,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000644,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003247,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053888,"duration_s":0.053569,"completed_at":"2026-09-08T05:58:29.765Z","load_balancing_strategy":"primary","db_duration_s":0.0044,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 239.044468] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.768Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"61b17ac2ebc8ea3a59174073","created_at":"2026-09-08T05:58:28.439Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-476541b0d6a9496e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"73f004fa260d149292523028efc3eedf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:28.472Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-61b17ac2ebc8ea3a59174073: start","job_status":"start","queue_duration_s":1.296101,"scheduling_latency_s":1.296122}1276gitlab # [ 239.056881] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.787Z","message":"No existing merge request to be cleaned up."}1277gitlab # [ 239.058577] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.803Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"61b17ac2ebc8ea3a59174073","created_at":"2026-09-08T05:58:28.439Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-476541b0d6a9496e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"73f004fa260d149292523028efc3eedf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:28.472Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-61b17ac2ebc8ea3a59174073: done: 0.034786 sec","job_status":"done","queue_duration_s":1.296101,"scheduling_latency_s":1.296122,"redis_calls":10,"redis_duration_s":0.004035,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002081,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034786,"completed_at":"2026-09-08T05:58:29.803Z","load_balancing_strategy":"primary","db_duration_s":0.002586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 239.097051] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.806Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e4106a0bd6ed64d18fc2e773","created_at":"2026-09-08T05:58:28.439Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-476541b0d6a9496e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"73f004fa260d149292523028efc3eedf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:28.472Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e4106a0bd6ed64d18fc2e773: start","job_status":"start","queue_duration_s":1.333599,"scheduling_latency_s":1.333648}1279gitlab # [ 239.109342] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.825Z","message":"No existing merge request to be cleaned up."}1280gitlab # [ 239.111001] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.845Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e4106a0bd6ed64d18fc2e773","created_at":"2026-09-08T05:58:28.439Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-476541b0d6a9496e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"73f004fa260d149292523028efc3eedf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:28.472Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e4106a0bd6ed64d18fc2e773: done: 0.039817 sec","job_status":"done","queue_duration_s":1.333599,"scheduling_latency_s":1.333648,"redis_calls":10,"redis_duration_s":0.003982,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001623,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002359,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039817,"completed_at":"2026-09-08T05:58:29.845Z","load_balancing_strategy":"primary","db_duration_s":0.002008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281gitlab # [ 239.150996] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.849Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9ef20dcca5251aa6541dee12","created_at":"2026-09-08T05:58:28.439Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-476541b0d6a9496e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"73f004fa260d149292523028efc3eedf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:28.472Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9ef20dcca5251aa6541dee12: start","job_status":"start","queue_duration_s":1.376745,"scheduling_latency_s":1.376765}1282gitlab # [ 239.163427] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.872Z","message":"No existing merge request to be cleaned up."}1283gitlab # [ 239.165239] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.892Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9ef20dcca5251aa6541dee12","created_at":"2026-09-08T05:58:28.439Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-476541b0d6a9496e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"73f004fa260d149292523028efc3eedf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:28.472Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9ef20dcca5251aa6541dee12: done: 0.04319 sec","job_status":"done","queue_duration_s":1.376745,"scheduling_latency_s":1.376765,"redis_calls":10,"redis_duration_s":0.004425,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002522,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04319,"completed_at":"2026-09-08T05:58:29.892Z","load_balancing_strategy":"primary","db_duration_s":0.002332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 239.204336] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88d77bd4030090ecd7c0d3ae","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88d77bd4030090ecd7c0d3ae: start","job_status":"start","queue_duration_s":0.341028,"scheduling_latency_s":0.341048}1285gitlab # [ 239.216722] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88d77bd4030090ecd7c0d3ae","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88d77bd4030090ecd7c0d3ae: done: 0.051398 sec","job_status":"done","queue_duration_s":0.341028,"scheduling_latency_s":0.341048,"redis_calls":16,"redis_duration_s":0.006942,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000919,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003431,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007798,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.051398,"completed_at":"2026-09-08T05:58:29.947Z","load_balancing_strategy":"primary","db_duration_s":0.000661,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 239.257771] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c72675ce6f754ab24e1d4c71","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c72675ce6f754ab24e1d4c71: start","job_status":"start","queue_duration_s":0.395066,"scheduling_latency_s":0.395087}1287gitlab # [ 239.269918] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c72675ce6f754ab24e1d4c71","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c72675ce6f754ab24e1d4c71: done: 0.03144 sec","job_status":"done","queue_duration_s":0.395066,"scheduling_latency_s":0.395087,"redis_calls":13,"redis_duration_s":0.003984,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002423,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03144,"completed_at":"2026-09-08T05:58:29.981Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 239.308749] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:29.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38fc0f295e491a76e20b01f5","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38fc0f295e491a76e20b01f5: start","job_status":"start","queue_duration_s":0.429274,"scheduling_latency_s":0.429294}1289gitlab # [ 239.322150] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38fc0f295e491a76e20b01f5","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38fc0f295e491a76e20b01f5: done: 0.039848 sec","job_status":"done","queue_duration_s":0.429274,"scheduling_latency_s":0.429294,"redis_calls":13,"redis_duration_s":0.009365,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005255,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00411,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039848,"completed_at":"2026-09-08T05:58:30.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 239.360912] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c7a089ad6716889f6f4af11","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c7a089ad6716889f6f4af11: start","job_status":"start","queue_duration_s":0.471738,"scheduling_latency_s":0.471758}1291gitlab # [ 239.373188] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c7a089ad6716889f6f4af11","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c7a089ad6716889f6f4af11: done: 0.036457 sec","job_status":"done","queue_duration_s":0.471738,"scheduling_latency_s":0.471758,"redis_calls":13,"redis_duration_s":0.005209,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003152,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036457,"completed_at":"2026-09-08T05:58:30.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 239.411936] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f96fc52f6e2fcb70de51e451","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f96fc52f6e2fcb70de51e451: start","job_status":"start","queue_duration_s":0.514082,"scheduling_latency_s":0.514105}1293gitlab # [ 239.424761] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f96fc52f6e2fcb70de51e451","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f96fc52f6e2fcb70de51e451: done: 0.024139 sec","job_status":"done","queue_duration_s":0.514082,"scheduling_latency_s":0.514105,"redis_calls":13,"redis_duration_s":0.003178,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00196,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024139,"completed_at":"2026-09-08T05:58:30.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 239.463406] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d259d89cfc3fb36773cf09a1","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d259d89cfc3fb36773cf09a1: start","job_status":"start","queue_duration_s":0.539622,"scheduling_latency_s":0.539662}1295gitlab # [ 239.476039] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d259d89cfc3fb36773cf09a1","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d259d89cfc3fb36773cf09a1: done: 0.01567 sec","job_status":"done","queue_duration_s":0.539622,"scheduling_latency_s":0.539662,"redis_calls":13,"redis_duration_s":0.002558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001651,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01567,"completed_at":"2026-09-08T05:58:30.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 239.515195] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86a0214afb72f1a0fe861ec5","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86a0214afb72f1a0fe861ec5: start","job_status":"start","queue_duration_s":0.556732,"scheduling_latency_s":0.55675}1297gitlab # [ 239.528707] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86a0214afb72f1a0fe861ec5","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86a0214afb72f1a0fe861ec5: done: 0.015776 sec","job_status":"done","queue_duration_s":0.556732,"scheduling_latency_s":0.55675,"redis_calls":13,"redis_duration_s":0.00273,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001817,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015776,"completed_at":"2026-09-08T05:58:30.127Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 239.567561] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94f9b65ca7c7a189a78e2eaa","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94f9b65ca7c7a189a78e2eaa: start","job_status":"start","queue_duration_s":0.574192,"scheduling_latency_s":0.57421}1299gitlab # [ 239.579908] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94f9b65ca7c7a189a78e2eaa","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94f9b65ca7c7a189a78e2eaa: done: 0.016596 sec","job_status":"done","queue_duration_s":0.574192,"scheduling_latency_s":0.57421,"redis_calls":13,"redis_duration_s":0.003136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001753,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016596,"completed_at":"2026-09-08T05:58:30.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 239.618535] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be283215fbeb7998b6cb88cb","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be283215fbeb7998b6cb88cb: start","job_status":"start","queue_duration_s":0.592313,"scheduling_latency_s":0.59233}1301gitlab # [ 239.630875] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be283215fbeb7998b6cb88cb","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be283215fbeb7998b6cb88cb: done: 0.015612 sec","job_status":"done","queue_duration_s":0.592313,"scheduling_latency_s":0.59233,"redis_calls":13,"redis_duration_s":0.002732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015612,"completed_at":"2026-09-08T05:58:30.162Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 239.669716] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6f85cb7310996eb131d5790","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6f85cb7310996eb131d5790: start","job_status":"start","queue_duration_s":0.609229,"scheduling_latency_s":0.609245}1303gitlab # [ 239.682138] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6f85cb7310996eb131d5790","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6f85cb7310996eb131d5790: done: 0.015987 sec","job_status":"done","queue_duration_s":0.609229,"scheduling_latency_s":0.609245,"redis_calls":13,"redis_duration_s":0.0027860000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001827,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015987,"completed_at":"2026-09-08T05:58:30.179Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 239.721124] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23e62302806330477754ac48","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23e62302806330477754ac48: start","job_status":"start","queue_duration_s":0.626545,"scheduling_latency_s":0.626562}1305gitlab # [ 239.734229] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23e62302806330477754ac48","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23e62302806330477754ac48: done: 0.015828 sec","job_status":"done","queue_duration_s":0.626545,"scheduling_latency_s":0.626562,"redis_calls":13,"redis_duration_s":0.002676,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015828,"completed_at":"2026-09-08T05:58:30.196Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 239.773229] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a94a40b340bae700bc6025ba","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a94a40b340bae700bc6025ba: start","job_status":"start","queue_duration_s":0.643832,"scheduling_latency_s":0.643849}1307gitlab # [ 239.785618] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a94a40b340bae700bc6025ba","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a94a40b340bae700bc6025ba: done: 0.015663 sec","job_status":"done","queue_duration_s":0.643832,"scheduling_latency_s":0.643849,"redis_calls":13,"redis_duration_s":0.002641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015663,"completed_at":"2026-09-08T05:58:30.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 239.824421] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f20d6125b8c6b1e30886e20","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f20d6125b8c6b1e30886e20: start","job_status":"start","queue_duration_s":0.660638,"scheduling_latency_s":0.660654}1309gitlab # [ 239.836601] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f20d6125b8c6b1e30886e20","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f20d6125b8c6b1e30886e20: done: 0.016114 sec","job_status":"done","queue_duration_s":0.660638,"scheduling_latency_s":0.660654,"redis_calls":13,"redis_duration_s":0.002908,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016114,"completed_at":"2026-09-08T05:58:30.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 239.875585] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ba4cd7a86f71ecbfede78bc","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ba4cd7a86f71ecbfede78bc: start","job_status":"start","queue_duration_s":0.678136,"scheduling_latency_s":0.678152}1311gitlab # [ 239.888103] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ba4cd7a86f71ecbfede78bc","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ba4cd7a86f71ecbfede78bc: done: 0.015381 sec","job_status":"done","queue_duration_s":0.678136,"scheduling_latency_s":0.678152,"redis_calls":13,"redis_duration_s":0.002646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015381,"completed_at":"2026-09-08T05:58:30.248Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 239.926892] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b42c6a6a61a75affddf975e4","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b42c6a6a61a75affddf975e4: start","job_status":"start","queue_duration_s":0.695223,"scheduling_latency_s":0.695241}1313gitlab # [ 239.940301] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b42c6a6a61a75affddf975e4","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b42c6a6a61a75affddf975e4: done: 0.01591 sec","job_status":"done","queue_duration_s":0.695223,"scheduling_latency_s":0.695241,"redis_calls":13,"redis_duration_s":0.002692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01591,"completed_at":"2026-09-08T05:58:30.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 239.978623] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7cec686ea557b85027ad8da","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7cec686ea557b85027ad8da: start","job_status":"start","queue_duration_s":0.712543,"scheduling_latency_s":0.71256}1315gitlab # [ 239.991278] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7cec686ea557b85027ad8da","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7cec686ea557b85027ad8da: done: 0.01611 sec","job_status":"done","queue_duration_s":0.712543,"scheduling_latency_s":0.71256,"redis_calls":13,"redis_duration_s":0.002844,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01611,"completed_at":"2026-09-08T05:58:30.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 240.030513] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a23fcecce67053c95769eae","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a23fcecce67053c95769eae: start","job_status":"start","queue_duration_s":0.730173,"scheduling_latency_s":0.73019}1317gitlab # [ 240.043022] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a23fcecce67053c95769eae","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a23fcecce67053c95769eae: done: 0.015216 sec","job_status":"done","queue_duration_s":0.730173,"scheduling_latency_s":0.73019,"redis_calls":13,"redis_duration_s":0.002298,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001456,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015216,"completed_at":"2026-09-08T05:58:30.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 240.081812] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d69f9b34b39edd0c2b3d4b5f","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d69f9b34b39edd0c2b3d4b5f: start","job_status":"start","queue_duration_s":0.746902,"scheduling_latency_s":0.746918}1319gitlab # [ 240.094168] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d69f9b34b39edd0c2b3d4b5f","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d69f9b34b39edd0c2b3d4b5f: done: 0.015992 sec","job_status":"done","queue_duration_s":0.746902,"scheduling_latency_s":0.746918,"redis_calls":13,"redis_duration_s":0.002726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001794,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015992,"completed_at":"2026-09-08T05:58:30.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 240.134117] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de201ab2b3e8963a0de3621e","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de201ab2b3e8963a0de3621e: start","job_status":"start","queue_duration_s":0.764397,"scheduling_latency_s":0.764414}1321gitlab # [ 240.146493] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de201ab2b3e8963a0de3621e","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de201ab2b3e8963a0de3621e: done: 0.015555 sec","job_status":"done","queue_duration_s":0.764397,"scheduling_latency_s":0.764414,"redis_calls":13,"redis_duration_s":0.0028640000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001802,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015555,"completed_at":"2026-09-08T05:58:30.334Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 240.185149] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97ccb8d3a2e12e9bab4c23f4","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97ccb8d3a2e12e9bab4c23f4: start","job_status":"start","queue_duration_s":0.781269,"scheduling_latency_s":0.781285}1323gitlab # [ 240.197548] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97ccb8d3a2e12e9bab4c23f4","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97ccb8d3a2e12e9bab4c23f4: done: 0.016365 sec","job_status":"done","queue_duration_s":0.781269,"scheduling_latency_s":0.781285,"redis_calls":13,"redis_duration_s":0.002664,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016365,"completed_at":"2026-09-08T05:58:30.352Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 240.236522] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68101c5d93e83e651d8cd7d3","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68101c5d93e83e651d8cd7d3: start","job_status":"start","queue_duration_s":0.799063,"scheduling_latency_s":0.79908}1325gitlab # [ 240.248763] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68101c5d93e83e651d8cd7d3","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68101c5d93e83e651d8cd7d3: done: 0.015975 sec","job_status":"done","queue_duration_s":0.799063,"scheduling_latency_s":0.79908,"redis_calls":13,"redis_duration_s":0.002814,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015975,"completed_at":"2026-09-08T05:58:30.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 240.287248] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2cc071c4b18d0c69300d4d8","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2cc071c4b18d0c69300d4d8: start","job_status":"start","queue_duration_s":0.816377,"scheduling_latency_s":0.816394}1327gitlab # [ 240.299662] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2cc071c4b18d0c69300d4d8","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2cc071c4b18d0c69300d4d8: done: 0.015931 sec","job_status":"done","queue_duration_s":0.816377,"scheduling_latency_s":0.816394,"redis_calls":13,"redis_duration_s":0.002754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001844,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015931,"completed_at":"2026-09-08T05:58:30.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 240.339885] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e31f184feed2b0f9d6939b8e","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e31f184feed2b0f9d6939b8e: start","job_status":"start","queue_duration_s":0.833612,"scheduling_latency_s":0.833626}1329gitlab # [ 240.352382] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e31f184feed2b0f9d6939b8e","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e31f184feed2b0f9d6939b8e: done: 0.015642 sec","job_status":"done","queue_duration_s":0.833612,"scheduling_latency_s":0.833626,"redis_calls":13,"redis_duration_s":0.002523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001626,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015642,"completed_at":"2026-09-08T05:58:30.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 240.390939] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7324d45275846f714c4e9fad","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7324d45275846f714c4e9fad: start","job_status":"start","queue_duration_s":0.850661,"scheduling_latency_s":0.850678}1331gitlab # [ 240.403746] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7324d45275846f714c4e9fad","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7324d45275846f714c4e9fad: done: 0.01579 sec","job_status":"done","queue_duration_s":0.850661,"scheduling_latency_s":0.850678,"redis_calls":13,"redis_duration_s":0.002745,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01579,"completed_at":"2026-09-08T05:58:30.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 240.442827] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46a08d04683508028fc8d998","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46a08d04683508028fc8d998: start","job_status":"start","queue_duration_s":0.868093,"scheduling_latency_s":0.86811}1333gitlab # [ 240.455063] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46a08d04683508028fc8d998","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46a08d04683508028fc8d998: done: 0.015901 sec","job_status":"done","queue_duration_s":0.868093,"scheduling_latency_s":0.86811,"redis_calls":13,"redis_duration_s":0.002766,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015901,"completed_at":"2026-09-08T05:58:30.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 240.493490] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdf237862f5070440b68e3d7","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdf237862f5070440b68e3d7: start","job_status":"start","queue_duration_s":0.885551,"scheduling_latency_s":0.885569}1335gitlab # [ 240.505811] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdf237862f5070440b68e3d7","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdf237862f5070440b68e3d7: done: 0.016346 sec","job_status":"done","queue_duration_s":0.885551,"scheduling_latency_s":0.885569,"redis_calls":13,"redis_duration_s":0.0027990000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001845,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016346,"completed_at":"2026-09-08T05:58:30.456Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 240.545884] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"816b7dccc605dcb04b461c18","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-816b7dccc605dcb04b461c18: start","job_status":"start","queue_duration_s":0.903461,"scheduling_latency_s":0.903477}1337gitlab # [ 240.558232] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"816b7dccc605dcb04b461c18","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-816b7dccc605dcb04b461c18: done: 0.016187 sec","job_status":"done","queue_duration_s":0.903461,"scheduling_latency_s":0.903477,"redis_calls":13,"redis_duration_s":0.002831,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016187,"completed_at":"2026-09-08T05:58:30.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 240.596841] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6aa6a1a98f0ea6681533fd13","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6aa6a1a98f0ea6681533fd13: start","job_status":"start","queue_duration_s":0.921348,"scheduling_latency_s":0.921365}1339gitlab # [ 240.609124] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6aa6a1a98f0ea6681533fd13","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6aa6a1a98f0ea6681533fd13: done: 0.015626 sec","job_status":"done","queue_duration_s":0.921348,"scheduling_latency_s":0.921365,"redis_calls":13,"redis_duration_s":0.002679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001766,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015626,"completed_at":"2026-09-08T05:58:30.491Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 240.647531] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4c32561e0b186ce9caab7a3","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4c32561e0b186ce9caab7a3: start","job_status":"start","queue_duration_s":0.938534,"scheduling_latency_s":0.938551}1341gitlab # [ 240.659882] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4c32561e0b186ce9caab7a3","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4c32561e0b186ce9caab7a3: done: 0.016089 sec","job_status":"done","queue_duration_s":0.938534,"scheduling_latency_s":0.938551,"redis_calls":13,"redis_duration_s":0.0027630000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016089,"completed_at":"2026-09-08T05:58:30.509Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 240.698854] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c853704e56e2ba205e6d5c4","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c853704e56e2ba205e6d5c4: start","job_status":"start","queue_duration_s":0.956033,"scheduling_latency_s":0.956051}1343gitlab # [ 240.710965] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c853704e56e2ba205e6d5c4","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c853704e56e2ba205e6d5c4: done: 0.016559 sec","job_status":"done","queue_duration_s":0.956033,"scheduling_latency_s":0.956051,"redis_calls":13,"redis_duration_s":0.003002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016559,"completed_at":"2026-09-08T05:58:30.527Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 240.750488] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59d2b2b0a3d452257c730ff7","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59d2b2b0a3d452257c730ff7: start","job_status":"start","queue_duration_s":0.974133,"scheduling_latency_s":0.974151}1345gitlab # [ 240.762514] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59d2b2b0a3d452257c730ff7","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59d2b2b0a3d452257c730ff7: done: 0.016939 sec","job_status":"done","queue_duration_s":0.974133,"scheduling_latency_s":0.974151,"redis_calls":13,"redis_duration_s":0.0033569999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002382,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016939,"completed_at":"2026-09-08T05:58:30.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 240.801248] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b01baf5d4c8afcbb17d7176f","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b01baf5d4c8afcbb17d7176f: start","job_status":"start","queue_duration_s":0.99252,"scheduling_latency_s":0.992537}1347gitlab # [ 240.813597] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b01baf5d4c8afcbb17d7176f","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b01baf5d4c8afcbb17d7176f: done: 0.016778 sec","job_status":"done","queue_duration_s":0.99252,"scheduling_latency_s":0.992537,"redis_calls":13,"redis_duration_s":0.002857,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016778,"completed_at":"2026-09-08T05:58:30.563Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 240.851963] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d90897a0f3a25a637e0a874","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d90897a0f3a25a637e0a874: start","job_status":"start","queue_duration_s":1.010718,"scheduling_latency_s":1.010735}1349gitlab # [ 240.864049] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d90897a0f3a25a637e0a874","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d90897a0f3a25a637e0a874: done: 0.016237 sec","job_status":"done","queue_duration_s":1.010718,"scheduling_latency_s":1.010735,"redis_calls":13,"redis_duration_s":0.00282,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016237,"completed_at":"2026-09-08T05:58:30.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 240.902286] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08d14b618822a77382193a8b","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08d14b618822a77382193a8b: start","job_status":"start","queue_duration_s":1.028334,"scheduling_latency_s":1.028353}1351gitlab # [ 240.914716] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08d14b618822a77382193a8b","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08d14b618822a77382193a8b: done: 0.016519 sec","job_status":"done","queue_duration_s":1.028334,"scheduling_latency_s":1.028353,"redis_calls":13,"redis_duration_s":0.002932,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016519,"completed_at":"2026-09-08T05:58:30.599Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 240.954011] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5686e36281c60b8e1f8c9e1","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5686e36281c60b8e1f8c9e1: start","job_status":"start","queue_duration_s":1.046466,"scheduling_latency_s":1.046483}1353gitlab # [ 240.966374] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5686e36281c60b8e1f8c9e1","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5686e36281c60b8e1f8c9e1: done: 0.015563 sec","job_status":"done","queue_duration_s":1.046466,"scheduling_latency_s":1.046483,"redis_calls":13,"redis_duration_s":0.00269,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001774,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015563,"completed_at":"2026-09-08T05:58:30.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 241.004375] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a7d479e8d70a707e2482895","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a7d479e8d70a707e2482895: start","job_status":"start","queue_duration_s":1.063548,"scheduling_latency_s":1.063564}1355gitlab # [ 241.016512] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a7d479e8d70a707e2482895","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a7d479e8d70a707e2482895: done: 0.015475 sec","job_status":"done","queue_duration_s":1.063548,"scheduling_latency_s":1.063564,"redis_calls":13,"redis_duration_s":0.002534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015475,"completed_at":"2026-09-08T05:58:30.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 241.055231] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c12022236b56d49e8d9c1d9c","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c12022236b56d49e8d9c1d9c: start","job_status":"start","queue_duration_s":1.080502,"scheduling_latency_s":1.080518}1357gitlab # [ 241.067955] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c12022236b56d49e8d9c1d9c","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c12022236b56d49e8d9c1d9c: done: 0.015968 sec","job_status":"done","queue_duration_s":1.080502,"scheduling_latency_s":1.080518,"redis_calls":13,"redis_duration_s":0.002932,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015968,"completed_at":"2026-09-08T05:58:30.651Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 241.106995] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0c311f809af438b5426aa20","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0c311f809af438b5426aa20: start","job_status":"start","queue_duration_s":1.09881,"scheduling_latency_s":1.09886}1359gitlab # [ 241.119317] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0c311f809af438b5426aa20","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0c311f809af438b5426aa20: done: 0.034925 sec","job_status":"done","queue_duration_s":1.09881,"scheduling_latency_s":1.09886,"redis_calls":13,"redis_duration_s":0.0033439999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001289,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034925,"completed_at":"2026-09-08T05:58:30.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 241.158783] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"491a386516da756cc108879e","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-491a386516da756cc108879e: start","job_status":"start","queue_duration_s":1.136067,"scheduling_latency_s":1.13609}1361gitlab # [ 241.171163] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"491a386516da756cc108879e","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-491a386516da756cc108879e: done: 0.019761 sec","job_status":"done","queue_duration_s":1.136067,"scheduling_latency_s":1.13609,"redis_calls":13,"redis_duration_s":0.003249,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002188,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019761,"completed_at":"2026-09-08T05:58:30.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 241.209741] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28a74da919f15b764a6cef18","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28a74da919f15b764a6cef18: start","job_status":"start","queue_duration_s":1.157473,"scheduling_latency_s":1.157496}1363gitlab # [ 241.221951] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28a74da919f15b764a6cef18","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28a74da919f15b764a6cef18: done: 0.021553 sec","job_status":"done","queue_duration_s":1.157473,"scheduling_latency_s":1.157496,"redis_calls":13,"redis_duration_s":0.0023239999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001481,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021553,"completed_at":"2026-09-08T05:58:30.733Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 241.260461] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"804476f4a8ef81d23ebc70de","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-804476f4a8ef81d23ebc70de: start","job_status":"start","queue_duration_s":1.180781,"scheduling_latency_s":1.180807}1365gitlab # [ 241.272672] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"804476f4a8ef81d23ebc70de","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-804476f4a8ef81d23ebc70de: done: 0.021808 sec","job_status":"done","queue_duration_s":1.180781,"scheduling_latency_s":1.180807,"redis_calls":13,"redis_duration_s":0.002131,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001353,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021808,"completed_at":"2026-09-08T05:58:30.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 241.310973] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba01dad0e85f4990f6d0c70b","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba01dad0e85f4990f6d0c70b: start","job_status":"start","queue_duration_s":1.204052,"scheduling_latency_s":1.204077}1367gitlab # [ 241.323216] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba01dad0e85f4990f6d0c70b","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba01dad0e85f4990f6d0c70b: done: 0.020242 sec","job_status":"done","queue_duration_s":1.204052,"scheduling_latency_s":1.204077,"redis_calls":13,"redis_duration_s":0.002254,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020242,"completed_at":"2026-09-08T05:58:30.778Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 241.362722] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81253a69b728e7205a245f73","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81253a69b728e7205a245f73: start","job_status":"start","queue_duration_s":1.225729,"scheduling_latency_s":1.225757}1369gitlab # [ 241.374939] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:30.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81253a69b728e7205a245f73","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81253a69b728e7205a245f73: done: 0.018171 sec","job_status":"done","queue_duration_s":1.225729,"scheduling_latency_s":1.225757,"redis_calls":13,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000595,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018171,"completed_at":"2026-09-08T05:58:30.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 241.413950] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7031ffe4203da5dec50d42e4","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7031ffe4203da5dec50d42e4: start","job_status":"start","queue_duration_s":1.472046,"scheduling_latency_s":1.472077}1371gitlab # [ 241.426334] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7031ffe4203da5dec50d42e4","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7031ffe4203da5dec50d42e4: done: 0.07997 sec","job_status":"done","queue_duration_s":1.472046,"scheduling_latency_s":1.472077,"redis_calls":13,"redis_duration_s":0.001767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.07997,"completed_at":"2026-09-08T05:58:31.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 241.464829] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4a6cb8ecf508105ec7c574a","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4a6cb8ecf508105ec7c574a: start","job_status":"start","queue_duration_s":1.553472,"scheduling_latency_s":1.553491}1373gitlab # [ 241.476797] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4a6cb8ecf508105ec7c574a","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4a6cb8ecf508105ec7c574a: done: 0.015059 sec","job_status":"done","queue_duration_s":1.553472,"scheduling_latency_s":1.553491,"redis_calls":13,"redis_duration_s":0.001489,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015059,"completed_at":"2026-09-08T05:58:31.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 241.515369] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4472e1e883c10f76303bbd5e","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4472e1e883c10f76303bbd5e: start","job_status":"start","queue_duration_s":1.5709,"scheduling_latency_s":1.570919}1375gitlab # [ 241.527789] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4472e1e883c10f76303bbd5e","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4472e1e883c10f76303bbd5e: done: 0.015656 sec","job_status":"done","queue_duration_s":1.5709,"scheduling_latency_s":1.570919,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015656,"completed_at":"2026-09-08T05:58:31.141Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 241.567457] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b4d972e04bb100a97ca102b","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b4d972e04bb100a97ca102b: start","job_status":"start","queue_duration_s":1.587618,"scheduling_latency_s":1.587653}1377gitlab # [ 241.579983] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b4d972e04bb100a97ca102b","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b4d972e04bb100a97ca102b: done: 0.016121 sec","job_status":"done","queue_duration_s":1.587618,"scheduling_latency_s":1.587653,"redis_calls":13,"redis_duration_s":0.001541,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016121,"completed_at":"2026-09-08T05:58:31.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 241.618423] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d95c350c14681703be8636df","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d95c350c14681703be8636df: start","job_status":"start","queue_duration_s":1.60481,"scheduling_latency_s":1.604827}1379gitlab # [ 241.630534] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d95c350c14681703be8636df","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d95c350c14681703be8636df: done: 0.015966 sec","job_status":"done","queue_duration_s":1.60481,"scheduling_latency_s":1.604827,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015966,"completed_at":"2026-09-08T05:58:31.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 241.669147] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5432ec30870d09c7aca543e2","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5432ec30870d09c7aca543e2: start","job_status":"start","queue_duration_s":1.621883,"scheduling_latency_s":1.6219}1381gitlab # [ 241.681321] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5432ec30870d09c7aca543e2","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5432ec30870d09c7aca543e2: done: 0.015832 sec","job_status":"done","queue_duration_s":1.621883,"scheduling_latency_s":1.6219,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015832,"completed_at":"2026-09-08T05:58:31.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 241.719911] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec6961ac2cc43e2dc134a52b","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec6961ac2cc43e2dc134a52b: start","job_status":"start","queue_duration_s":1.640345,"scheduling_latency_s":1.640364}1383gitlab # [ 241.732480] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:58:31.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec6961ac2cc43e2dc134a52b","created_at":"2026-09-08T05:58:29.378Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-69020e04696f474e","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"afeb973492e9108016f40ef03134705f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:29.554Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec6961ac2cc43e2dc134a52b: done: 0.015993 sec","job_status":"done","queue_duration_s":1.640345,"scheduling_latency_s":1.640364,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015993,"completed_at":"2026-09-08T05:58:31.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 271.547077] setup-gitlab-start[2944]: W, [2026-09-08T05:59:02.404131 #2944] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1385gitlab # [ 273.475325] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"0dda9d220968c7bf9724912f","created_at":"2026-09-08T05:59:04.312Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f1b936022eddafbd2a280a5c490a9a3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.327Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-0dda9d220968c7bf9724912f: start","job_status":"start","queue_duration_s":0.004081,"scheduling_latency_s":0.004137}1386gitlab # [ 273.595236] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.452Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"0dda9d220968c7bf9724912f","created_at":"2026-09-08T05:59:04.312Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f1b936022eddafbd2a280a5c490a9a3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.327Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-0dda9d220968c7bf9724912f: done: 0.120785 sec","job_status":"done","queue_duration_s":0.004081,"scheduling_latency_s":0.004137,"redis_calls":13,"redis_duration_s":0.027938,"redis_read_bytes":268,"redis_write_bytes":1356,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.006131,"redis_feature_flag_read_bytes":260,"redis_feature_flag_write_bytes":117,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011197,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.01061,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02526266,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.120785,"completed_at":"2026-09-08T05:59:04.452Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015846,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1387gitlab # [ 273.676701] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.476Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"15aed66ef17ff857af3fb87c","created_at":"2026-09-08T05:59:04.349Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6054d75fb2131a76e66d6fda22dee90","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.369Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-15aed66ef17ff857af3fb87c: start","job_status":"start","queue_duration_s":0.106293,"scheduling_latency_s":0.10636}1388gitlab # [ 273.995417] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"15aed66ef17ff857af3fb87c","created_at":"2026-09-08T05:59:04.349Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6054d75fb2131a76e66d6fda22dee90","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.369Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-15aed66ef17ff857af3fb87c: done: 0.37637 sec","job_status":"done","queue_duration_s":0.106293,"scheduling_latency_s":0.10636,"redis_calls":9,"redis_duration_s":0.01038,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005402,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004978,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.078,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.078,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00259792,"exclusive_lock_hold_duration_s":0.19130464,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.37637,"completed_at":"2026-09-08T05:59:04.852Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.194938,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 274.046077] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.856Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2829daf07e4916ed2366ad1f","created_at":"2026-09-08T05:59:04.400Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbec8b6335195afa46bdd37315cee44c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.411Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2829daf07e4916ed2366ad1f: start","job_status":"start","queue_duration_s":0.444684,"scheduling_latency_s":0.444735}1390gitlab # [ 274.059597] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.898Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2829daf07e4916ed2366ad1f","created_at":"2026-09-08T05:59:04.400Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbec8b6335195afa46bdd37315cee44c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.411Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2829daf07e4916ed2366ad1f: done: 0.042429 sec","job_status":"done","queue_duration_s":0.444684,"scheduling_latency_s":0.444735,"redis_calls":9,"redis_duration_s":0.003573,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001601,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00117256,"exclusive_lock_hold_duration_s":0.0073539,"duration_s":0.042429,"completed_at":"2026-09-08T05:59:04.898Z","load_balancing_strategy":"primary","db_duration_s":0.002531,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 274.099068] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.901Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b8e023464d01d9d2eda25bf6","created_at":"2026-09-08T05:59:04.430Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fa5636293cd3b1414452d89d9ce20a6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.444Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b8e023464d01d9d2eda25bf6: start","job_status":"start","queue_duration_s":0.456321,"scheduling_latency_s":0.456356}1392gitlab # [ 274.112603] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b8e023464d01d9d2eda25bf6","created_at":"2026-09-08T05:59:04.430Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fa5636293cd3b1414452d89d9ce20a6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.444Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b8e023464d01d9d2eda25bf6: done: 0.049237 sec","job_status":"done","queue_duration_s":0.456321,"scheduling_latency_s":0.456356,"redis_calls":7,"redis_duration_s":0.004667,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000837,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.049237,"completed_at":"2026-09-08T05:59:04.950Z","load_balancing_strategy":"primary","db_duration_s":0.017008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 274.153022] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1adfb60bb471d93a8dc6e4db","created_at":"2026-09-08T05:59:04.467Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af6699d7490a2bd75bbd499cbcd87d26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.474Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1adfb60bb471d93a8dc6e4db: start","job_status":"start","queue_duration_s":0.479113,"scheduling_latency_s":0.479152}1394gitlab # [ 274.167256] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.973Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1395gitlab # [ 274.171133] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.983Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1adfb60bb471d93a8dc6e4db","created_at":"2026-09-08T05:59:04.467Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af6699d7490a2bd75bbd499cbcd87d26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.474Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1adfb60bb471d93a8dc6e4db: done: 0.02955 sec","job_status":"done","queue_duration_s":0.479113,"scheduling_latency_s":0.479152,"redis_calls":7,"redis_duration_s":0.002423,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000662,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02955,"completed_at":"2026-09-08T05:59:04.983Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 274.212239] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:04.985Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ba40cf59497f686cf71c1d8f","created_at":"2026-09-08T05:59:04.522Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e25db75b1e6c684023800ee56c569aa1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.526Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ba40cf59497f686cf71c1d8f: start","job_status":"start","queue_duration_s":0.458722,"scheduling_latency_s":0.458749}1397gitlab # [ 274.226655] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:05.073Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ba40cf59497f686cf71c1d8f","created_at":"2026-09-08T05:59:04.522Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e25db75b1e6c684023800ee56c569aa1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.526Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ba40cf59497f686cf71c1d8f: done: 0.088011 sec","job_status":"done","queue_duration_s":0.458722,"scheduling_latency_s":0.458749,"redis_calls":9,"redis_duration_s":0.003975,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001889,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00129724,"exclusive_lock_hold_duration_s":0.0320705,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.088011,"completed_at":"2026-09-08T05:59:05.073Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03546,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 274.268787] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:05.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"49e49434a6e9c6df5d8115f6","created_at":"2026-09-08T05:59:04.618Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6089df6d0e7f0fed644e72a3ecae452a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.625Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-49e49434a6e9c6df5d8115f6: start","job_status":"start","queue_duration_s":0.456575,"scheduling_latency_s":0.456619}1399gitlab # [ 274.283230] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:05.104Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1400gitlab # [ 274.286607] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:05.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"49e49434a6e9c6df5d8115f6","created_at":"2026-09-08T05:59:04.618Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6089df6d0e7f0fed644e72a3ecae452a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.625Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-49e49434a6e9c6df5d8115f6: done: 0.033059 sec","job_status":"done","queue_duration_s":0.456575,"scheduling_latency_s":0.456619,"redis_calls":7,"redis_duration_s":0.002761,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001964,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000797,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033059,"completed_at":"2026-09-08T05:59:05.115Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 274.327087] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:05.117Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2549ae4fd54ce3b0f7ae756f","created_at":"2026-09-08T05:59:04.632Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ec8f0ea7247385413221fd88e17d8d7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.636Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2549ae4fd54ce3b0f7ae756f: start","job_status":"start","queue_duration_s":0.481001,"scheduling_latency_s":0.481029}1402gitlab # [ 274.341060] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:05.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2549ae4fd54ce3b0f7ae756f","created_at":"2026-09-08T05:59:04.632Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ec8f0ea7247385413221fd88e17d8d7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.636Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2549ae4fd54ce3b0f7ae756f: done: 0.034802 sec","job_status":"done","queue_duration_s":0.481001,"scheduling_latency_s":0.481029,"redis_calls":7,"redis_duration_s":0.002264,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034802,"completed_at":"2026-09-08T05:59:05.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 274.381325] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:05.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"49f43c0dbf3c057f33903eb4","created_at":"2026-09-08T05:59:04.640Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"69d915522fc818a45bbfe69f3fd312d5","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.645Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-49f43c0dbf3c057f33903eb4: start","job_status":"start","queue_duration_s":0.513201,"scheduling_latency_s":0.513229}1404gitlab # [ 276.434781] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.290Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"49f43c0dbf3c057f33903eb4","created_at":"2026-09-08T05:59:04.640Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"69d915522fc818a45bbfe69f3fd312d5","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.645Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-49f43c0dbf3c057f33903eb4: done: 2.131983 sec","job_status":"done","queue_duration_s":0.513201,"scheduling_latency_s":0.513229,"redis_calls":562,"redis_duration_s":1.3306930000000001,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005101,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":1.325592,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.949115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":2.131983,"completed_at":"2026-09-08T05:59:07.290Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 276.447215] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d064d60ea7ce77af25d82902","created_at":"2026-09-08T05:59:04.650Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9bada1e2274d7d71e66da15c757b47a9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.654Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d064d60ea7ce77af25d82902: start","job_status":"start","queue_duration_s":2.650452,"scheduling_latency_s":2.650512}1406gitlab # [ 276.598323] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.456Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1407gitlab # [ 276.632290] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d064d60ea7ce77af25d82902","created_at":"2026-09-08T05:59:04.650Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9bada1e2274d7d71e66da15c757b47a9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.654Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d064d60ea7ce77af25d82902: done: 0.184961 sec","job_status":"done","queue_duration_s":2.650452,"scheduling_latency_s":2.650512,"redis_calls":7,"redis_duration_s":0.010159999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008306,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001854,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.184961,"completed_at":"2026-09-08T05:59:07.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 276.698862] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.503Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3f9febe4a6bcf35a54383525","created_at":"2026-09-08T05:59:04.665Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2743c9aa94cb14f3c7313927570bb0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.668Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3f9febe4a6bcf35a54383525: start","job_status":"start","queue_duration_s":2.834736,"scheduling_latency_s":2.834784}1409gitlab # [ 276.767395] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"3f9febe4a6bcf35a54383525","created_at":"2026-09-08T05:59:04.665Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2743c9aa94cb14f3c7313927570bb0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.668Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-3f9febe4a6bcf35a54383525: done: 0.121729 sec","job_status":"done","queue_duration_s":2.834736,"scheduling_latency_s":2.834784,"redis_calls":14,"redis_duration_s":0.021918,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.00087,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.016301,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.004747,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.121729,"completed_at":"2026-09-08T05:59:07.625Z","load_balancing_strategy":"primary","db_duration_s":0.001913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 276.814181] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.636Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"575a76577cfcb985d1fc0418","created_at":"2026-09-08T05:59:04.672Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"496dee13da71744451b5c612c6e5e2ea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.675Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-575a76577cfcb985d1fc0418: start","job_status":"start","queue_duration_s":2.961307,"scheduling_latency_s":2.961355}1411gitlab # [ 276.877090] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.734Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"575a76577cfcb985d1fc0418","created_at":"2026-09-08T05:59:04.672Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"496dee13da71744451b5c612c6e5e2ea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.675Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-575a76577cfcb985d1fc0418: done: 0.097891 sec","job_status":"done","queue_duration_s":2.961307,"scheduling_latency_s":2.961355,"redis_calls":8,"redis_duration_s":0.017992,"redis_read_bytes":133,"redis_write_bytes":846,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000993,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011607,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005392,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.097891,"completed_at":"2026-09-08T05:59:07.734Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 276.960866] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6933cbcdb41fe3aaaea66bbb","created_at":"2026-09-08T05:59:04.685Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f8a4c03f04958defa28c1a6104e9ada","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T05:59:04.689Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6933cbcdb41fe3aaaea66bbb: start","job_status":"start","queue_duration_s":3.049471,"scheduling_latency_s":3.049496}1413gitlab # [ 276.979904] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.784Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1414gitlab # [ 276.984280] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.803Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6933cbcdb41fe3aaaea66bbb","created_at":"2026-09-08T05:59:04.685Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f8a4c03f04958defa28c1a6104e9ada","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T05:59:04.689Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6933cbcdb41fe3aaaea66bbb: done: 0.064913 sec","job_status":"done","queue_duration_s":3.049471,"scheduling_latency_s":3.049496,"redis_calls":7,"redis_duration_s":0.001788,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001309,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000479,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064913,"completed_at":"2026-09-08T05:59:07.803Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 277.025878] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9a5a7aa3e76028f44dac064b","created_at":"2026-09-08T05:59:04.701Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ba3cac59cd7444a79054d3c7d12b7fe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.705Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9a5a7aa3e76028f44dac064b: start","job_status":"start","queue_duration_s":3.103744,"scheduling_latency_s":3.103781}1416gitlab # [ 277.042763] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.900Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1417gitlab # [ 277.068388] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.925Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9a5a7aa3e76028f44dac064b","created_at":"2026-09-08T05:59:04.701Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ba3cac59cd7444a79054d3c7d12b7fe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.705Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9a5a7aa3e76028f44dac064b: done: 0.116472 sec","job_status":"done","queue_duration_s":3.103744,"scheduling_latency_s":3.103781,"redis_calls":7,"redis_duration_s":0.00269,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000742,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.116472,"completed_at":"2026-09-08T05:59:07.925Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 277.121282] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:07.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d9b65e23272a35e925fb7263","created_at":"2026-09-08T05:59:04.714Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"941e8e680f1cab3cf258714cbc41860b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T05:59:04.717Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d9b65e23272a35e925fb7263: start","job_status":"start","queue_duration_s":3.210661,"scheduling_latency_s":3.210708}1419gitlab # [ 277.154015] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:08.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d9b65e23272a35e925fb7263","created_at":"2026-09-08T05:59:04.714Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"941e8e680f1cab3cf258714cbc41860b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T05:59:04.717Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d9b65e23272a35e925fb7263: done: 0.082742 sec","job_status":"done","queue_duration_s":3.210661,"scheduling_latency_s":3.210708,"redis_calls":7,"redis_duration_s":0.010978,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007454,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003524,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.082742,"completed_at":"2026-09-08T05:59:08.011Z","load_balancing_strategy":"primary","db_duration_s":0.006023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 277.204222] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:08.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a05670fcbcdfeeccbdf27d36","created_at":"2026-09-08T05:59:04.728Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0638e5ae3dc2d8cfc5e3c58ce2a9cc42","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.731Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a05670fcbcdfeeccbdf27d36: start","job_status":"start","queue_duration_s":3.289274,"scheduling_latency_s":3.289324}1421gitlab # [ 278.320599] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:09.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a05670fcbcdfeeccbdf27d36","created_at":"2026-09-08T05:59:04.728Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0638e5ae3dc2d8cfc5e3c58ce2a9cc42","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.731Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a05670fcbcdfeeccbdf27d36: done: 1.155895 sec","job_status":"done","queue_duration_s":3.289274,"scheduling_latency_s":3.289324,"redis_calls":9,"redis_duration_s":0.021647,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009306,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.353,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.353,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.492336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00145158,"exclusive_lock_hold_duration_s":1.07250624,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":1.155895,"completed_at":"2026-09-08T05:59:09.176Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.653832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 278.432190] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:09.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0262ea6122e9c8c174e21fdc","created_at":"2026-09-08T05:59:04.742Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8606d2de11e279b9cc1668ca9548a220","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.744Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0262ea6122e9c8c174e21fdc: start","job_status":"start","queue_duration_s":4.544591,"scheduling_latency_s":4.544643}1423gitlab # [ 278.546290] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:09.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0262ea6122e9c8c174e21fdc","created_at":"2026-09-08T05:59:04.742Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8606d2de11e279b9cc1668ca9548a220","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.744Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0262ea6122e9c8c174e21fdc: done: 0.113774 sec","job_status":"done","queue_duration_s":4.544591,"scheduling_latency_s":4.544643,"redis_calls":7,"redis_duration_s":0.010334,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007504,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.113774,"completed_at":"2026-09-08T05:59:09.403Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 278.680120] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:09.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"51d1843ab0dab7d886a37987","created_at":"2026-09-08T05:59:04.755Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.758Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-51d1843ab0dab7d886a37987: start","job_status":"start","queue_duration_s":4.778949,"scheduling_latency_s":4.779002}1425gitlab # [ 279.173875] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"51d1843ab0dab7d886a37987","created_at":"2026-09-08T05:59:04.755Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.758Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-51d1843ab0dab7d886a37987: done: 0.490593 sec","job_status":"done","queue_duration_s":4.778949,"scheduling_latency_s":4.779002,"redis_calls":60,"redis_duration_s":0.110717,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.001205,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.106932,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.251496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.490593,"completed_at":"2026-09-08T05:59:10.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 279.261530] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"40b50dd28bf3c3a85c4014e8","created_at":"2026-09-08T05:59:04.762Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba1dded86f1476e989840d35dd42d9c8","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.769Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-40b50dd28bf3c3a85c4014e8: start","job_status":"start","queue_duration_s":5.264119,"scheduling_latency_s":5.264157}1427gitlab # [ 279.281310] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.068Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"40b50dd28bf3c3a85c4014e8","created_at":"2026-09-08T05:59:04.762Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba1dded86f1476e989840d35dd42d9c8","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.769Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-40b50dd28bf3c3a85c4014e8: done: 0.035125 sec","job_status":"done","queue_duration_s":5.264119,"scheduling_latency_s":5.264157,"redis_calls":9,"redis_duration_s":0.003369,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001689,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00168,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00080604,"exclusive_lock_hold_duration_s":0.0082565,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.035125,"completed_at":"2026-09-08T05:59:10.068Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004851,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 279.332193] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"da08337340631fc4cde8278f","created_at":"2026-09-08T05:59:04.778Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b99a704a4e6861837aee03388ebca38f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.781Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-da08337340631fc4cde8278f: start","job_status":"start","queue_duration_s":5.289217,"scheduling_latency_s":5.289245}1429gitlab # [ 279.346850] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.094Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"da08337340631fc4cde8278f","created_at":"2026-09-08T05:59:04.778Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b99a704a4e6861837aee03388ebca38f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:04.781Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-da08337340631fc4cde8278f: done: 0.023429 sec","job_status":"done","queue_duration_s":5.289217,"scheduling_latency_s":5.289245,"redis_calls":7,"redis_duration_s":0.0021590000000000003,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001556,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023429,"completed_at":"2026-09-08T05:59:10.094Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 279.387008] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.096Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"68926c2221b525cc12fe6474","created_at":"2026-09-08T05:59:04.809Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2c4764365778c7b88337a358b137c06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T05:59:04.812Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-68926c2221b525cc12fe6474: start","job_status":"start","queue_duration_s":5.283449,"scheduling_latency_s":5.283474}1431gitlab # [ 279.400139] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.108Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1432gitlab # [ 279.403713] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"68926c2221b525cc12fe6474","created_at":"2026-09-08T05:59:04.809Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-66bb9be5dd514977","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2c4764365778c7b88337a358b137c06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T05:59:04.812Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-68926c2221b525cc12fe6474: done: 0.018998 sec","job_status":"done","queue_duration_s":5.283449,"scheduling_latency_s":5.283474,"redis_calls":7,"redis_duration_s":0.0021479999999999997,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001645,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018998,"completed_at":"2026-09-08T05:59:10.115Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 279.442692] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.117Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dba56d50da234a67d1cd5015","created_at":"2026-09-08T05:59:07.581Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-d6b41c8b54e64a46","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2743c9aa94cb14f3c7313927570bb0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:07.605Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dba56d50da234a67d1cd5015: start","job_status":"start","queue_duration_s":2.511663,"scheduling_latency_s":2.511685}1434gitlab # [ 279.456303] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.132Z","message":"No existing merge request to be cleaned up."}1435gitlab # [ 279.457978] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.143Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dba56d50da234a67d1cd5015","created_at":"2026-09-08T05:59:07.581Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-d6b41c8b54e64a46","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2743c9aa94cb14f3c7313927570bb0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:07.605Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dba56d50da234a67d1cd5015: done: 0.026175 sec","job_status":"done","queue_duration_s":2.511663,"scheduling_latency_s":2.511685,"redis_calls":10,"redis_duration_s":0.002694,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001603,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026175,"completed_at":"2026-09-08T05:59:10.143Z","load_balancing_strategy":"primary","db_duration_s":0.003198,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 279.495623] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.146Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9634a5017342871ff44e429a","created_at":"2026-09-08T05:59:07.581Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-d6b41c8b54e64a46","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2743c9aa94cb14f3c7313927570bb0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:07.605Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9634a5017342871ff44e429a: start","job_status":"start","queue_duration_s":2.540662,"scheduling_latency_s":2.540707}1437gitlab # [ 279.507966] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.159Z","message":"No existing merge request to be cleaned up."}1438gitlab # [ 279.509736] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.171Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9634a5017342871ff44e429a","created_at":"2026-09-08T05:59:07.581Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-d6b41c8b54e64a46","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2743c9aa94cb14f3c7313927570bb0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:07.605Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9634a5017342871ff44e429a: done: 0.024876 sec","job_status":"done","queue_duration_s":2.540662,"scheduling_latency_s":2.540707,"redis_calls":10,"redis_duration_s":0.002798,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001675,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024876,"completed_at":"2026-09-08T05:59:10.171Z","load_balancing_strategy":"primary","db_duration_s":0.002753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 279.547586] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.172Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d94283f583d061aa203c2d7f","created_at":"2026-09-08T05:59:07.581Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-d6b41c8b54e64a46","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2743c9aa94cb14f3c7313927570bb0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:07.605Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d94283f583d061aa203c2d7f: start","job_status":"start","queue_duration_s":2.567109,"scheduling_latency_s":2.567129}1440gitlab # [ 279.559662] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.185Z","message":"No existing merge request to be cleaned up."}1441gitlab # [ 279.561341] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.194Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d94283f583d061aa203c2d7f","created_at":"2026-09-08T05:59:07.581Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-d6b41c8b54e64a46","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2743c9aa94cb14f3c7313927570bb0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:07.605Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d94283f583d061aa203c2d7f: done: 0.022053 sec","job_status":"done","queue_duration_s":2.567109,"scheduling_latency_s":2.567129,"redis_calls":10,"redis_duration_s":0.0026100000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001525,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022053,"completed_at":"2026-09-08T05:59:10.194Z","load_balancing_strategy":"primary","db_duration_s":0.002491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 279.600209] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.196Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5c7c00bcb8257ef66c7743c7","created_at":"2026-09-08T05:59:07.581Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-d6b41c8b54e64a46","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2743c9aa94cb14f3c7313927570bb0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:07.605Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5c7c00bcb8257ef66c7743c7: start","job_status":"start","queue_duration_s":2.590736,"scheduling_latency_s":2.590755}1443gitlab # [ 279.612274] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.208Z","message":"No existing merge request to be cleaned up."}1444gitlab # [ 279.613959] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.218Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5c7c00bcb8257ef66c7743c7","created_at":"2026-09-08T05:59:07.581Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-d6b41c8b54e64a46","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2743c9aa94cb14f3c7313927570bb0a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:07.605Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5c7c00bcb8257ef66c7743c7: done: 0.021703 sec","job_status":"done","queue_duration_s":2.590736,"scheduling_latency_s":2.590755,"redis_calls":10,"redis_duration_s":0.002443,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001433,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021703,"completed_at":"2026-09-08T05:59:10.217Z","load_balancing_strategy":"primary","db_duration_s":0.002392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 279.651725] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddd53721408fad43dbfe47e5","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddd53721408fad43dbfe47e5: start","job_status":"start","queue_duration_s":0.207463,"scheduling_latency_s":0.207481}1446gitlab # [ 279.665616] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddd53721408fad43dbfe47e5","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddd53721408fad43dbfe47e5: done: 0.017525 sec","job_status":"done","queue_duration_s":0.207463,"scheduling_latency_s":0.207481,"redis_calls":13,"redis_duration_s":0.0030080000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017525,"completed_at":"2026-09-08T05:59:10.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 279.704654] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd04dfdd1678f8487d3acb48","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd04dfdd1678f8487d3acb48: start","job_status":"start","queue_duration_s":0.226574,"scheduling_latency_s":0.226592}1448gitlab # [ 279.717011] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd04dfdd1678f8487d3acb48","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd04dfdd1678f8487d3acb48: done: 0.016085 sec","job_status":"done","queue_duration_s":0.226574,"scheduling_latency_s":0.226592,"redis_calls":13,"redis_duration_s":0.002771,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001846,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016085,"completed_at":"2026-09-08T05:59:10.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 279.755504] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b534258e9b4dbfbd0b7ae2bc","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b534258e9b4dbfbd0b7ae2bc: start","job_status":"start","queue_duration_s":0.244024,"scheduling_latency_s":0.244042}1450gitlab # [ 279.767887] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b534258e9b4dbfbd0b7ae2bc","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b534258e9b4dbfbd0b7ae2bc: done: 0.015917 sec","job_status":"done","queue_duration_s":0.244024,"scheduling_latency_s":0.244042,"redis_calls":13,"redis_duration_s":0.00254,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001585,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015917,"completed_at":"2026-09-08T05:59:10.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 279.806412] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4715c057c5a1986229da6819","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4715c057c5a1986229da6819: start","job_status":"start","queue_duration_s":0.262611,"scheduling_latency_s":0.26263}1452gitlab # [ 279.818633] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4715c057c5a1986229da6819","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4715c057c5a1986229da6819: done: 0.016517 sec","job_status":"done","queue_duration_s":0.262611,"scheduling_latency_s":0.26263,"redis_calls":13,"redis_duration_s":0.002675,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001746,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016517,"completed_at":"2026-09-08T05:59:10.291Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 279.857745] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5feed22dfea6caeefbac73b9","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5feed22dfea6caeefbac73b9: start","job_status":"start","queue_duration_s":0.280479,"scheduling_latency_s":0.280494}1454gitlab # [ 279.871397] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5feed22dfea6caeefbac73b9","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5feed22dfea6caeefbac73b9: done: 0.016279 sec","job_status":"done","queue_duration_s":0.280479,"scheduling_latency_s":0.280494,"redis_calls":13,"redis_duration_s":0.002767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016279,"completed_at":"2026-09-08T05:59:10.308Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 279.910431] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"443df4b7bb844dc057b33bad","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-443df4b7bb844dc057b33bad: start","job_status":"start","queue_duration_s":0.29819,"scheduling_latency_s":0.298207}1456gitlab # [ 279.922767] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"443df4b7bb844dc057b33bad","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-443df4b7bb844dc057b33bad: done: 0.016657 sec","job_status":"done","queue_duration_s":0.29819,"scheduling_latency_s":0.298207,"redis_calls":13,"redis_duration_s":0.002746,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001804,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016657,"completed_at":"2026-09-08T05:59:10.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 279.961517] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d8aca2edcf52b468bcdcbe4","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d8aca2edcf52b468bcdcbe4: start","job_status":"start","queue_duration_s":0.317185,"scheduling_latency_s":0.317203}1458gitlab # [ 279.973957] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d8aca2edcf52b468bcdcbe4","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d8aca2edcf52b468bcdcbe4: done: 0.016062 sec","job_status":"done","queue_duration_s":0.317185,"scheduling_latency_s":0.317203,"redis_calls":13,"redis_duration_s":0.002804,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016062,"completed_at":"2026-09-08T05:59:10.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 280.012758] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fd7978651bb01330d7dc2bc","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fd7978651bb01330d7dc2bc: start","job_status":"start","queue_duration_s":0.334601,"scheduling_latency_s":0.334617}1460gitlab # [ 280.025147] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fd7978651bb01330d7dc2bc","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fd7978651bb01330d7dc2bc: done: 0.016509 sec","job_status":"done","queue_duration_s":0.334601,"scheduling_latency_s":0.334617,"redis_calls":13,"redis_duration_s":0.002927,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016509,"completed_at":"2026-09-08T05:59:10.363Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 280.064181] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87b25ea00697ce4a881be868","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87b25ea00697ce4a881be868: start","job_status":"start","queue_duration_s":0.352481,"scheduling_latency_s":0.352497}1462gitlab # [ 280.077734] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87b25ea00697ce4a881be868","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87b25ea00697ce4a881be868: done: 0.015986 sec","job_status":"done","queue_duration_s":0.352481,"scheduling_latency_s":0.352497,"redis_calls":13,"redis_duration_s":0.002683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015986,"completed_at":"2026-09-08T05:59:10.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 280.116634] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"494b51ec49e6a0dfbc056787","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-494b51ec49e6a0dfbc056787: start","job_status":"start","queue_duration_s":0.369807,"scheduling_latency_s":0.369824}1464gitlab # [ 280.128683] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"494b51ec49e6a0dfbc056787","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-494b51ec49e6a0dfbc056787: done: 0.018341 sec","job_status":"done","queue_duration_s":0.369807,"scheduling_latency_s":0.369824,"redis_calls":13,"redis_duration_s":0.0028640000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018341,"completed_at":"2026-09-08T05:59:10.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 280.167619] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01defc95c73d23fabea89f70","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01defc95c73d23fabea89f70: start","job_status":"start","queue_duration_s":0.389518,"scheduling_latency_s":0.389534}1466gitlab # [ 280.180111] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01defc95c73d23fabea89f70","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01defc95c73d23fabea89f70: done: 0.016149 sec","job_status":"done","queue_duration_s":0.389518,"scheduling_latency_s":0.389534,"redis_calls":13,"redis_duration_s":0.002879,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016149,"completed_at":"2026-09-08T05:59:10.417Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 280.218837] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ece2e1b1b3c2334ca9b205bb","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ece2e1b1b3c2334ca9b205bb: start","job_status":"start","queue_duration_s":0.407067,"scheduling_latency_s":0.407083}1468gitlab # [ 280.231272] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ece2e1b1b3c2334ca9b205bb","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ece2e1b1b3c2334ca9b205bb: done: 0.016127 sec","job_status":"done","queue_duration_s":0.407067,"scheduling_latency_s":0.407083,"redis_calls":13,"redis_duration_s":0.002755,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001771,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016127,"completed_at":"2026-09-08T05:59:10.435Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 280.270023] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bc9a101296398dcf61b0fec","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bc9a101296398dcf61b0fec: start","job_status":"start","queue_duration_s":0.424686,"scheduling_latency_s":0.424702}1470gitlab # [ 280.283715] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bc9a101296398dcf61b0fec","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bc9a101296398dcf61b0fec: done: 0.016153 sec","job_status":"done","queue_duration_s":0.424686,"scheduling_latency_s":0.424702,"redis_calls":13,"redis_duration_s":0.002719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001804,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016153,"completed_at":"2026-09-08T05:59:10.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 280.322567] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a52cad17a86d99ad6be36ec2","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a52cad17a86d99ad6be36ec2: start","job_status":"start","queue_duration_s":0.443009,"scheduling_latency_s":0.443025}1472gitlab # [ 280.335184] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a52cad17a86d99ad6be36ec2","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a52cad17a86d99ad6be36ec2: done: 0.016112 sec","job_status":"done","queue_duration_s":0.443009,"scheduling_latency_s":0.443025,"redis_calls":13,"redis_duration_s":0.002713,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016112,"completed_at":"2026-09-08T05:59:10.471Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 280.373705] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aed608c4f43576157acc457","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aed608c4f43576157acc457: start","job_status":"start","queue_duration_s":0.460531,"scheduling_latency_s":0.460547}1474gitlab # [ 280.385966] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aed608c4f43576157acc457","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aed608c4f43576157acc457: done: 0.017918 sec","job_status":"done","queue_duration_s":0.460531,"scheduling_latency_s":0.460547,"redis_calls":13,"redis_duration_s":0.0028339999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017918,"completed_at":"2026-09-08T05:59:10.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 280.424574] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ac233b46b7b2fc1487d34fd","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ac233b46b7b2fc1487d34fd: start","job_status":"start","queue_duration_s":0.479818,"scheduling_latency_s":0.479834}1476gitlab # [ 280.437191] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ac233b46b7b2fc1487d34fd","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ac233b46b7b2fc1487d34fd: done: 0.015973 sec","job_status":"done","queue_duration_s":0.479818,"scheduling_latency_s":0.479834,"redis_calls":13,"redis_duration_s":0.002769,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015973,"completed_at":"2026-09-08T05:59:10.507Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 280.476763] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"688a46e50d87c7e451ea192c","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-688a46e50d87c7e451ea192c: start","job_status":"start","queue_duration_s":0.497626,"scheduling_latency_s":0.497644}1478gitlab # [ 280.488922] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"688a46e50d87c7e451ea192c","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-688a46e50d87c7e451ea192c: done: 0.018537 sec","job_status":"done","queue_duration_s":0.497626,"scheduling_latency_s":0.497644,"redis_calls":13,"redis_duration_s":0.002338,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001465,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018537,"completed_at":"2026-09-08T05:59:10.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 280.527117] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd4c2bedc54fbb19c792ca78","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd4c2bedc54fbb19c792ca78: start","job_status":"start","queue_duration_s":0.517331,"scheduling_latency_s":0.517348}1480gitlab # [ 280.539328] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd4c2bedc54fbb19c792ca78","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd4c2bedc54fbb19c792ca78: done: 0.016657 sec","job_status":"done","queue_duration_s":0.517331,"scheduling_latency_s":0.517348,"redis_calls":13,"redis_duration_s":0.001666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016657,"completed_at":"2026-09-08T05:59:10.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 280.577614] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c1b1ef8758a05dc947c888","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c1b1ef8758a05dc947c888: start","job_status":"start","queue_duration_s":0.535091,"scheduling_latency_s":0.535108}1482gitlab # [ 280.589801] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c1b1ef8758a05dc947c888","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c1b1ef8758a05dc947c888: done: 0.015698 sec","job_status":"done","queue_duration_s":0.535091,"scheduling_latency_s":0.535108,"redis_calls":13,"redis_duration_s":0.001516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015698,"completed_at":"2026-09-08T05:59:10.562Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 280.628070] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65430d5b6cdf91ff0bdc37df","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65430d5b6cdf91ff0bdc37df: start","job_status":"start","queue_duration_s":0.551921,"scheduling_latency_s":0.551938}1484gitlab # [ 280.640735] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65430d5b6cdf91ff0bdc37df","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65430d5b6cdf91ff0bdc37df: done: 0.015891 sec","job_status":"done","queue_duration_s":0.551921,"scheduling_latency_s":0.551938,"redis_calls":13,"redis_duration_s":0.001564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015891,"completed_at":"2026-09-08T05:59:10.579Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 280.680900] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3320249808b6ca1d1bef06a","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3320249808b6ca1d1bef06a: start","job_status":"start","queue_duration_s":0.569849,"scheduling_latency_s":0.569866}1486gitlab # [ 280.692975] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3320249808b6ca1d1bef06a","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3320249808b6ca1d1bef06a: done: 0.015794 sec","job_status":"done","queue_duration_s":0.569849,"scheduling_latency_s":0.569866,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015794,"completed_at":"2026-09-08T05:59:10.597Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 280.731904] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"665fd714a65fe731200bbe4f","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-665fd714a65fe731200bbe4f: start","job_status":"start","queue_duration_s":0.586746,"scheduling_latency_s":0.586762}1488gitlab # [ 280.744621] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"665fd714a65fe731200bbe4f","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-665fd714a65fe731200bbe4f: done: 0.016137 sec","job_status":"done","queue_duration_s":0.586746,"scheduling_latency_s":0.586762,"redis_calls":13,"redis_duration_s":0.001716,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016137,"completed_at":"2026-09-08T05:59:10.614Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 280.783633] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01b7ee18b30d49fb76d0de8","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01b7ee18b30d49fb76d0de8: start","job_status":"start","queue_duration_s":0.603966,"scheduling_latency_s":0.603983}1490gitlab # [ 280.796234] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01b7ee18b30d49fb76d0de8","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01b7ee18b30d49fb76d0de8: done: 0.018013 sec","job_status":"done","queue_duration_s":0.603966,"scheduling_latency_s":0.603983,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018013,"completed_at":"2026-09-08T05:59:10.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 280.835195] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"658e856d01604a0d9a47bf25","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-658e856d01604a0d9a47bf25: start","job_status":"start","queue_duration_s":0.623053,"scheduling_latency_s":0.62307}1492gitlab # [ 280.847539] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"658e856d01604a0d9a47bf25","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-658e856d01604a0d9a47bf25: done: 0.015553 sec","job_status":"done","queue_duration_s":0.623053,"scheduling_latency_s":0.62307,"redis_calls":13,"redis_duration_s":0.001476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015553,"completed_at":"2026-09-08T05:59:10.650Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 280.887414] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ef09fa9d47bb758da02853f","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ef09fa9d47bb758da02853f: start","job_status":"start","queue_duration_s":0.641211,"scheduling_latency_s":0.641231}1494gitlab # [ 280.899903] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ef09fa9d47bb758da02853f","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ef09fa9d47bb758da02853f: done: 0.016552 sec","job_status":"done","queue_duration_s":0.641211,"scheduling_latency_s":0.641231,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016552,"completed_at":"2026-09-08T05:59:10.669Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 280.938542] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8801757a5581e8da8b5c1a0c","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8801757a5581e8da8b5c1a0c: start","job_status":"start","queue_duration_s":0.658851,"scheduling_latency_s":0.658869}1496gitlab # [ 280.950726] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8801757a5581e8da8b5c1a0c","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8801757a5581e8da8b5c1a0c: done: 0.015795 sec","job_status":"done","queue_duration_s":0.658851,"scheduling_latency_s":0.658869,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015795,"completed_at":"2026-09-08T05:59:10.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 280.989261] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ad3fc67469be04a1dd2c5e2","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ad3fc67469be04a1dd2c5e2: start","job_status":"start","queue_duration_s":0.675705,"scheduling_latency_s":0.675722}1498gitlab # [ 281.001408] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ad3fc67469be04a1dd2c5e2","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ad3fc67469be04a1dd2c5e2: done: 0.016221 sec","job_status":"done","queue_duration_s":0.675705,"scheduling_latency_s":0.675722,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016221,"completed_at":"2026-09-08T05:59:10.703Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 281.040528] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33718ca0569e02be0d50e6c7","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33718ca0569e02be0d50e6c7: start","job_status":"start","queue_duration_s":0.694001,"scheduling_latency_s":0.69403}1500gitlab # [ 281.052689] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33718ca0569e02be0d50e6c7","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33718ca0569e02be0d50e6c7: done: 0.017023 sec","job_status":"done","queue_duration_s":0.694001,"scheduling_latency_s":0.69403,"redis_calls":13,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017023,"completed_at":"2026-09-08T05:59:10.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 281.092394] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0796b85260f26449babfe916","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0796b85260f26449babfe916: start","job_status":"start","queue_duration_s":0.711179,"scheduling_latency_s":0.711196}1502gitlab # [ 281.104532] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0796b85260f26449babfe916","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0796b85260f26449babfe916: done: 0.015895 sec","job_status":"done","queue_duration_s":0.711179,"scheduling_latency_s":0.711196,"redis_calls":13,"redis_duration_s":0.0015470000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015895,"completed_at":"2026-09-08T05:59:10.739Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 281.142914] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d82e2a2e95e305d5993b160d","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d82e2a2e95e305d5993b160d: start","job_status":"start","queue_duration_s":0.728149,"scheduling_latency_s":0.728166}1504gitlab # [ 281.155222] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d82e2a2e95e305d5993b160d","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d82e2a2e95e305d5993b160d: done: 0.015649 sec","job_status":"done","queue_duration_s":0.728149,"scheduling_latency_s":0.728166,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015649,"completed_at":"2026-09-08T05:59:10.755Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 281.193723] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05e41e2ee94fc79dda06babf","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05e41e2ee94fc79dda06babf: start","job_status":"start","queue_duration_s":0.744877,"scheduling_latency_s":0.744894}1506gitlab # [ 281.206349] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05e41e2ee94fc79dda06babf","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05e41e2ee94fc79dda06babf: done: 0.015283 sec","job_status":"done","queue_duration_s":0.744877,"scheduling_latency_s":0.744894,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015283,"completed_at":"2026-09-08T05:59:10.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 281.244855] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ce3a094c91dacc81bde5f59","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ce3a094c91dacc81bde5f59: start","job_status":"start","queue_duration_s":0.762347,"scheduling_latency_s":0.762365}1508gitlab # [ 281.257147] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ce3a094c91dacc81bde5f59","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ce3a094c91dacc81bde5f59: done: 0.016797 sec","job_status":"done","queue_duration_s":0.762347,"scheduling_latency_s":0.762365,"redis_calls":13,"redis_duration_s":0.0015340000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016797,"completed_at":"2026-09-08T05:59:10.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 281.296889] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f5a6cb57389a869860db347","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f5a6cb57389a869860db347: start","job_status":"start","queue_duration_s":0.780272,"scheduling_latency_s":0.78029}1510gitlab # [ 281.309024] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.806Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f5a6cb57389a869860db347","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f5a6cb57389a869860db347: done: 0.014202 sec","job_status":"done","queue_duration_s":0.780272,"scheduling_latency_s":0.78029,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014202,"completed_at":"2026-09-08T05:59:10.806Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 281.347665] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae258b72a6b2ea4f1c929b82","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae258b72a6b2ea4f1c929b82: start","job_status":"start","queue_duration_s":0.795524,"scheduling_latency_s":0.795541}1512gitlab # [ 281.360097] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae258b72a6b2ea4f1c929b82","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae258b72a6b2ea4f1c929b82: done: 0.015005 sec","job_status":"done","queue_duration_s":0.795524,"scheduling_latency_s":0.795541,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015005,"completed_at":"2026-09-08T05:59:10.822Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 281.398444] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5c3bde21079965e76159aaa","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5c3bde21079965e76159aaa: start","job_status":"start","queue_duration_s":0.811568,"scheduling_latency_s":0.811584}1514gitlab # [ 281.410714] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5c3bde21079965e76159aaa","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5c3bde21079965e76159aaa: done: 0.01511 sec","job_status":"done","queue_duration_s":0.811568,"scheduling_latency_s":0.811584,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01511,"completed_at":"2026-09-08T05:59:10.838Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 281.449109] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cfc2a90921e6d3f004800d9","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cfc2a90921e6d3f004800d9: start","job_status":"start","queue_duration_s":0.827769,"scheduling_latency_s":0.827785}1516gitlab # [ 281.461072] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cfc2a90921e6d3f004800d9","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cfc2a90921e6d3f004800d9: done: 0.01464 sec","job_status":"done","queue_duration_s":0.827769,"scheduling_latency_s":0.827785,"redis_calls":13,"redis_duration_s":0.001455,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01464,"completed_at":"2026-09-08T05:59:10.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 281.500752] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d948a85e9a6760bfef8d3024","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d948a85e9a6760bfef8d3024: start","job_status":"start","queue_duration_s":0.843482,"scheduling_latency_s":0.843499}1518gitlab # [ 281.512896] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d948a85e9a6760bfef8d3024","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d948a85e9a6760bfef8d3024: done: 0.014935 sec","job_status":"done","queue_duration_s":0.843482,"scheduling_latency_s":0.843499,"redis_calls":13,"redis_duration_s":0.001518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014935,"completed_at":"2026-09-08T05:59:10.870Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 281.550996] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2cfeebc7af32415fbbd56e4","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2cfeebc7af32415fbbd56e4: start","job_status":"start","queue_duration_s":0.859485,"scheduling_latency_s":0.859501}1520gitlab # [ 281.563359] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2cfeebc7af32415fbbd56e4","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2cfeebc7af32415fbbd56e4: done: 0.015098 sec","job_status":"done","queue_duration_s":0.859485,"scheduling_latency_s":0.859501,"redis_calls":13,"redis_duration_s":0.001537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015098,"completed_at":"2026-09-08T05:59:10.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 281.601723] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b28cb6b9691cd93072fc675","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b28cb6b9691cd93072fc675: start","job_status":"start","queue_duration_s":0.876026,"scheduling_latency_s":0.876044}1522gitlab # [ 281.613667] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b28cb6b9691cd93072fc675","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b28cb6b9691cd93072fc675: done: 0.01471 sec","job_status":"done","queue_duration_s":0.876026,"scheduling_latency_s":0.876044,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01471,"completed_at":"2026-09-08T05:59:10.902Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 281.652202] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fc80b1128a5a3c8269784cb","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fc80b1128a5a3c8269784cb: start","job_status":"start","queue_duration_s":0.89179,"scheduling_latency_s":0.891807}1524gitlab # [ 281.664213] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fc80b1128a5a3c8269784cb","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fc80b1128a5a3c8269784cb: done: 0.015187 sec","job_status":"done","queue_duration_s":0.89179,"scheduling_latency_s":0.891807,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015187,"completed_at":"2026-09-08T05:59:10.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 281.703829] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22f547822a4ab2260da59520","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22f547822a4ab2260da59520: start","job_status":"start","queue_duration_s":0.908092,"scheduling_latency_s":0.90811}1526gitlab # [ 281.716148] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22f547822a4ab2260da59520","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22f547822a4ab2260da59520: done: 0.014918 sec","job_status":"done","queue_duration_s":0.908092,"scheduling_latency_s":0.90811,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014918,"completed_at":"2026-09-08T05:59:10.934Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 281.754267] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"168b4aa5000242b73af068b2","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-168b4aa5000242b73af068b2: start","job_status":"start","queue_duration_s":0.924087,"scheduling_latency_s":0.924104}1528gitlab # [ 281.766590] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"168b4aa5000242b73af068b2","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-168b4aa5000242b73af068b2: done: 0.014999 sec","job_status":"done","queue_duration_s":0.924087,"scheduling_latency_s":0.924104,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014999,"completed_at":"2026-09-08T05:59:10.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 281.805181] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1917ec2ab04b3d6150c7cfc","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1917ec2ab04b3d6150c7cfc: start","job_status":"start","queue_duration_s":0.940148,"scheduling_latency_s":0.940165}1530gitlab # [ 281.817455] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1917ec2ab04b3d6150c7cfc","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1917ec2ab04b3d6150c7cfc: done: 0.014915 sec","job_status":"done","queue_duration_s":0.940148,"scheduling_latency_s":0.940165,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014915,"completed_at":"2026-09-08T05:59:10.966Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 281.856159] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bff59887efb3407ea4d30f0f","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bff59887efb3407ea4d30f0f: start","job_status":"start","queue_duration_s":0.956132,"scheduling_latency_s":0.956149}1532gitlab # [ 281.868126] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bff59887efb3407ea4d30f0f","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bff59887efb3407ea4d30f0f: done: 0.014544 sec","job_status":"done","queue_duration_s":0.956132,"scheduling_latency_s":0.956149,"redis_calls":13,"redis_duration_s":0.001413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014544,"completed_at":"2026-09-08T05:59:10.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 281.907754] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91cd8370a3aac66f5098cf6e","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91cd8370a3aac66f5098cf6e: start","job_status":"start","queue_duration_s":0.971727,"scheduling_latency_s":0.971744}1534gitlab # [ 281.920108] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:10.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91cd8370a3aac66f5098cf6e","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91cd8370a3aac66f5098cf6e: done: 0.015178 sec","job_status":"done","queue_duration_s":0.971727,"scheduling_latency_s":0.971744,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015178,"completed_at":"2026-09-08T05:59:10.998Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 281.958483] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:11.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a43aa6eb2399416187e430b","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a43aa6eb2399416187e430b: start","job_status":"start","queue_duration_s":0.988051,"scheduling_latency_s":0.988068}1536gitlab # [ 281.970595] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:11.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a43aa6eb2399416187e430b","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a43aa6eb2399416187e430b: done: 0.015234 sec","job_status":"done","queue_duration_s":0.988051,"scheduling_latency_s":0.988068,"redis_calls":13,"redis_duration_s":0.0017360000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015234,"completed_at":"2026-09-08T05:59:11.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 282.009035] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:11.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"642223d406c34ee42bee5b46","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-642223d406c34ee42bee5b46: start","job_status":"start","queue_duration_s":1.004337,"scheduling_latency_s":1.004354}1538gitlab # [ 282.021336] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:11.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"642223d406c34ee42bee5b46","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-642223d406c34ee42bee5b46: done: 0.014673 sec","job_status":"done","queue_duration_s":1.004337,"scheduling_latency_s":1.004354,"redis_calls":13,"redis_duration_s":0.001416,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014673,"completed_at":"2026-09-08T05:59:11.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 282.060279] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:11.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a4174bad9d319bb02c28460","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a4174bad9d319bb02c28460: start","job_status":"start","queue_duration_s":1.020083,"scheduling_latency_s":1.020101}1540gitlab # [ 282.072563] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:11.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a4174bad9d319bb02c28460","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a4174bad9d319bb02c28460: done: 0.014737 sec","job_status":"done","queue_duration_s":1.020083,"scheduling_latency_s":1.020101,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014737,"completed_at":"2026-09-08T05:59:11.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 282.112388] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:11.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa3a16eea3d20cc4eef80904","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa3a16eea3d20cc4eef80904: start","job_status":"start","queue_duration_s":1.036362,"scheduling_latency_s":1.036379}1542gitlab # [ 282.124434] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:11.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa3a16eea3d20cc4eef80904","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa3a16eea3d20cc4eef80904: done: 0.014699 sec","job_status":"done","queue_duration_s":1.036362,"scheduling_latency_s":1.036379,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014699,"completed_at":"2026-09-08T05:59:11.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 282.162944] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:11.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"941a4f5b25d302aed5a6db69","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-941a4f5b25d302aed5a6db69: start","job_status":"start","queue_duration_s":1.052133,"scheduling_latency_s":1.05215}1544gitlab # [ 282.175330] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:11.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"941a4f5b25d302aed5a6db69","created_at":"2026-09-08T05:59:09.621Z","trace_propagation_headers":{"sentry-trace":"a1de4893837e4adba841b04359dadbf3-a83aeb19931b43dd","baggage":"sentry-trace_id=a1de4893837e4adba841b04359dadbf3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"63b4d4f829ff206021a59e40a73cbdb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:59:10.011Z","job_size_bytes":2,"pid":2017,"sidekiq_tid":"maot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-941a4f5b25d302aed5a6db69: done: 0.014807 sec","job_status":"done","queue_duration_s":1.052133,"scheduling_latency_s":1.05215,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014807,"completed_at":"2026-09-08T05:59:11.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 309.242043] redis[784]: 10 changes in 300 seconds. Saving...1546gitlab # [ 309.247477] redis[784]: Background saving started by pid 32811547gitlab # [ 309.252493] redis[3281]: BGSAVE done, 444 keys saved, 0 keys skipped, 115997 bytes written.1548gitlab # [ 309.257265] redis[3281]: DB saved on disk1549gitlab # [ 309.259501] redis[3281]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1550gitlab # [ 309.344199] redis[784]: Background saving terminated with success1551gitlab # [ 310.398324] postgres[856]: [856] LOG: checkpoint starting: time1552gitlab # [ 312.066790] gitaly[910]: time="2026-09-08T05:59:42.923Z" level=info msg="burden monitor stats" pid=9101553gitlab # [ 313.851924] postgres[3276]: [3276] ERROR: relation "table_without_models" does not exist1554gitlab # [ 313.855488] postgres[3276]: [3276] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1555gitlab # [ 319.735341] runuser[2943]: pam_unix(runuser:session): session closed for user gitlab1556gitlab # [ 319.737338] setup-gitlab-start[2916]: + systemctl restart gitlab-sidekiq.service1557gitlab # [ 319.778930] systemd[1]: Stopping gitlab-sidekiq.service...1558gitlab # [ 319.782494] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:50.636Z","message":"Shutting down"}1559gitlab # [ 319.786779] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:50.637Z","message":"Scheduler exiting..."}1560gitlab # [ 319.791183] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:50.639Z","message":"Terminating quiet threads for default capsule"}1561gitlab # [ 319.796375] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:50.639Z","message":"Scheduler exiting..."}1562gitlab # [ 320.283280] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:51.140Z","message":"Pausing to allow jobs to finish..."}1563gitlab # [ 320.787308] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:51.643Z","message":"Bye!"}1564gitlab # [ 320.827973] sidekiq-cluster[2017]: {"severity":"INFO","time":"2026-09-08T05:59:51.685Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2017,"worker_id":"sidekiq_0","memwd_rss_bytes":952852480,"retry":0}1565gitlab # [ 323.543811] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1566gitlab # [ 323.544285] systemd[1]: Stopped gitlab-sidekiq.service.1567gitlab # [ 323.544511] systemd[1]: gitlab-sidekiq.service: Consumed 1min 54.316s CPU time over 3min 20.253s wall clock time, 947.7M memory peak, 4.4M read from disk.1568gitlab # [ 323.557873] systemd[1]: Started gitlab-sidekiq.service.1569gitlab # [ 323.562946] setup-gitlab-start[2916]: + mkdir -p /var/lib/secrets1570gitlab # [ 323.567473] setup-gitlab-start[2916]: + echo nixbot-test-token-of-20-chars1571gitlab # [ 323.570692] setup-gitlab-start[2916]: + chmod 644 /var/lib/secrets/gitlab-token1572gitlab # [ 323.574223] setup-gitlab-start[2916]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1573gitlab # [ 324.049409] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:05:59:54 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 4301574gitlab # [ 324.992863] gitaly[910]: time="2026-09-08T05:59:55.849Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:00:05.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:55.848" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1575gitlab # [ 325.023253] gitaly[910]: time="2026-09-08T05:59:55.849Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:00:05.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:55.848" grpc.time_ms=0.808 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1576gitlab # [ 325.199806] gitaly[910]: time="2026-09-08T05:59:56.057Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:00:06.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.057" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1577gitlab # [ 325.234759] gitaly[910]: time="2026-09-08T05:59:56.058Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:00:06.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.057" grpc.time_ms=0.569 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1578gitlab # [ 325.295516] gitaly[910]: time="2026-09-08T05:59:56.153Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 diskcache=f30cdf03-3762-4838-94c8-b6e9cfa6285d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T06:00:06.033" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.084" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1579gitlab # [ 325.318345] gitaly[910]: time="2026-09-08T05:59:56.154Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=37 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=44 command.spawn_token_fork_ms=4 command.system_time_ms=31 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T06:00:06.033" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.084" grpc.time_ms=69.17 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1580gitlab # [ 325.339773] gitaly[910]: time="2026-09-08T05:59:56.178Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:00:06.126" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.177" pid=910 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1581gitlab # [ 325.353707] gitaly[910]: time="2026-09-08T05:59:56.179Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:00:06.126" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.177" grpc.time_ms=1.469 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 325.366754] gitaly[910]: time="2026-09-08T05:59:56.202Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T06:00:06.136" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.186" grpc.time_ms=15.341 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 325.444577] gitaly[910]: time="2026-09-08T05:59:56.302Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:00:06.251" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.302" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1584gitlab # [ 325.475485] gitaly[910]: time="2026-09-08T05:59:56.302Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:00:06.251" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.302" grpc.time_ms=0.326 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1585gitlab # [ 325.510752] gitaly[910]: time="2026-09-08T05:59:56.368Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 diskcache=b3d256ae-9d66-442e-88b7-f3d2faefa7fb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T06:00:06.256" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.307" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1586gitlab # [ 325.533188] gitaly[910]: time="2026-09-08T05:59:56.369Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=35 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=40 command.spawn_token_fork_ms=4 command.system_time_ms=26 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T06:00:06.256" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.307" grpc.time_ms=61.458 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1587gitlab # [ 325.554427] gitaly[910]: time="2026-09-08T05:59:56.382Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:00:06.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.381" pid=910 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1588gitlab # [ 325.567890] gitaly[910]: time="2026-09-08T05:59:56.382Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:00:06.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.381" grpc.time_ms=1.321 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1589gitlab # [ 325.581592] gitaly[910]: time="2026-09-08T05:59:56.406Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T06:00:06.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.388" grpc.time_ms=17.611 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 325.613011] gitaly[910]: time="2026-09-08T05:59:56.471Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:00:06.089" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.470" grpc.time_ms=0.496 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1591gitlab # [ 325.629820] gitaly[910]: time="2026-09-08T05:59:56.487Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T06:00:06.106" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:56.487" grpc.time_ms=0.535 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 326.386210] gitaly[910]: time="2026-09-08T05:59:57.243Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM0S9BSKDJ7NB3DTYZ499 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T06:00:07.174" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:59:57.225" grpc.time_ms=17.357 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 327.178701] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:05:59:58 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 31131594gitlab # [ 327.182554] setup-gitlab-start[3359]: {"id":1,"message":null,"error":null}1595gitlab # [ 328.450394] sidekiq-cluster[3341]: {"severity":"INFO","time":"2026-09-08T05:59:59.280Z","message":"Starting cluster with 1 processes"}1596gitlab # [ 329.300073] systemd[1]: Starting Logrotate Service...1597gitlab # [ 329.447211] systemd[1]: logrotate.service: Deactivated successfully.1598gitlab # [ 329.450248] systemd[1]: Finished Logrotate Service.1599gitlab # [ 333.427776] gitaly[910]: time="2026-09-08T06:00:04.284Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSM8R7F2NJ68PK5KT5G64F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T06:00:14.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:00:04.266" grpc.time_ms=17.894 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1600gitlab # [ 336.066504] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:06 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 38441601gitlab # [ 336.073392] setup-gitlab-start[2916]: + mkdir -p /tmp/test-flake1602gitlab # [ 336.078498] setup-gitlab-start[2916]: + cd /tmp/test-flake1603gitlab # [ 336.079378] setup-gitlab-start[2916]: + git init -b master1604gitlab # [ 336.107155] setup-gitlab-start[3464]: Initialized empty Git repository in /tmp/test-flake/.git/1605gitlab # [ 336.108810] setup-gitlab-start[2916]: + git config user.name test1606gitlab # [ 336.115071] setup-gitlab-start[2916]: + git config user.email test@example.com1607gitlab # [ 336.122626] setup-gitlab-start[2916]: + cat1608gitlab # [ 336.128698] setup-gitlab-start[2916]: + git add flake.nix1609gitlab # [ 336.138160] setup-gitlab-start[2916]: + git commit -m 'initial commit'1610gitlab # [ 336.170659] setup-gitlab-start[3469]: [master (root-commit) 5009dc5] initial commit1611gitlab # [ 336.174215] setup-gitlab-start[3469]: 1 file changed, 10 insertions(+)1612gitlab # [ 336.176940] setup-gitlab-start[3469]: create mode 100644 flake.nix1613gitlab # [ 336.179538] setup-gitlab-start[2916]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1614gitlab # [ 336.186793] setup-gitlab-start[2916]: + git push -u origin master1615gitlab # [ 336.323829] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:07 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 911616gitlab # [ 336.504218] gitaly[910]: time="2026-09-08T06:00:07.361Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=11 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCRN32M4R120YR73BDV1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:07.341" grpc.time_ms=19.666 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1617gitlab # [ 336.521679] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:07 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1741618gitlab # [ 337.016761] gitaly[910]: time="2026-09-08T06:00:07.874Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T06:00:17.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:00:07.859" grpc.time_ms=15.175 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 337.094772] gitaly[910]: time="2026-09-08T06:00:07.952Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-08T06:00:37.036" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-08T06:00:07.936" grpc.time_ms=15.834 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 337.153173] gitaly[910]: time="2026-09-08T06:00:08.011Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 duration_ms=286ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/allowed"1621gitlab # [ 337.209053] gitaly[910]: time="2026-09-08T06:00:08.067Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 duration_ms=54ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/pre_receive"1622gitlab # [ 337.222039] gitaly[910]: time="2026-09-08T06:00:08.067Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:00:07.721" grpc.time_ms=345.962 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1623gitlab # [ 337.306336] gitaly[910]: time="2026-09-08T06:00:08.164Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:00:08.162" grpc.time_ms=1.33 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1624gitlab # [ 337.358960] gitaly[910]: time="2026-09-08T06:00:08.216Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:00:08.215" grpc.time_ms=0.91 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1625gitlab # [ 337.433475] gitaly[910]: time="2026-09-08T06:00:08.291Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:00:08.290" grpc.time_ms=0.801 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1626gitlab # [ 337.616103] gitaly[910]: time="2026-09-08T06:00:08.473Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T06:00:18.072" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:00:08.453" grpc.time_ms=19.813 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1627gitlab # [ 337.676418] gitaly[910]: time="2026-09-08T06:00:08.534Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=32 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=39 command.spawn_token_fork_ms=5 command.system_time_ms=20 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-08T06:00:18.109" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:00:08.489" grpc.time_ms=44.131 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1628gitlab # [ 337.711908] gitaly[910]: time="2026-09-08T06:00:08.570Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 duration_ms=224ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/post_receive"1629gitlab # [ 337.720253] gitaly[910]: time="2026-09-08T06:00:08.572Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:00:08.344" grpc.time_ms=227.282 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1630gitlab # [ 337.747351] gitaly[910]: time="2026-09-08T06:00:08.605Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 diskcache=9629db5f-79f3-4ac9-9ac4-e1348c644b0a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:07.603" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1631gitlab # [ 337.777830] gitaly[910]: time="2026-09-08T06:00:08.605Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=343 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13118 command.oublock=32 command.real_time_ms=991 command.spawn_token_fork_ms=2 command.system_time_ms=197 command.user_time_ms=146 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:07.603" grpc.time_ms=1002.214 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1632gitlab # [ 337.805944] systemd[1]: Finished setup-gitlab.service.1633gitlab # [ 337.807427] setup-gitlab-start[3473]: To http://gitlab/root/test-flake.git1634gitlab # [ 337.809040] setup-gitlab-start[3473]: * [new branch] master -> master1635gitlab # [ 337.810478] setup-gitlab-start[3473]: branch 'master' set up to track 'origin/master'.1636gitlab # [ 337.812600] gitlab-workhorse[815]: time="2026-09-08T06:00:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521637gitlab # [ 337.815403] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:08 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 12201638gitlab # [ 337.818442] systemd[1]: Starting nixbot CI service...1639gitlab: (finished: waiting for unit setup-gitlab.service, in 339.01 seconds)1640gitlab: waiting for unit nixbot.service1641gitlab # [ 339.074079] nixbot[3554]: {"ts": "2026-09-08T06:00:09.931Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1642gitlab # [ 339.112850] nixbot[3554]: {"ts": "2026-09-08T06:00:09.970Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1643gitlab # [ 339.130078] nixbot[3554]: {"ts": "2026-09-08T06:00:09.988Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1644gitlab # [ 339.139976] nixbot[3554]: {"ts": "2026-09-08T06:00:09.997Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1645gitlab # [ 339.147287] nixbot[3554]: {"ts": "2026-09-08T06:00:10.005Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1646gitlab # [ 339.159201] nixbot[3554]: {"ts": "2026-09-08T06:00:10.017Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1647gitlab # [ 339.167136] nixbot[3554]: {"ts": "2026-09-08T06:00:10.025Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1648gitlab # [ 339.170323] nixbot[3554]: {"ts": "2026-09-08T06:00:10.028Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1649gitlab # [ 339.182091] nixbot[3554]: {"ts": "2026-09-08T06:00:10.040Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1650gitlab # [ 339.185720] nixbot[3554]: {"ts": "2026-09-08T06:00:10.043Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1651gitlab # [ 339.195490] nixbot[3554]: {"ts": "2026-09-08T06:00:10.053Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1652gitlab # [ 339.207626] nixbot[3554]: {"ts": "2026-09-08T06:00:10.065Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1653gitlab # [ 339.213500] nixbot[3554]: {"ts": "2026-09-08T06:00:10.071Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1654gitlab # [ 339.218049] nixbot[3554]: {"ts": "2026-09-08T06:00:10.074Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1655gitlab # [ 339.223749] nixbot[3554]: {"ts": "2026-09-08T06:00:10.081Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1656gitlab # [ 339.228365] nixbot[3554]: {"ts": "2026-09-08T06:00:10.085Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1657gitlab # [ 339.232724] nixbot[3554]: {"ts": "2026-09-08T06:00:10.088Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1658gitlab # [ 339.237036] nixbot[3554]: {"ts": "2026-09-08T06:00:10.090Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1659gitlab # [ 339.241355] nixbot[3554]: {"ts": "2026-09-08T06:00:10.099Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1660gitlab # [ 339.245518] nixbot[3554]: {"ts": "2026-09-08T06:00:10.102Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1661gitlab # [ 339.249739] nixbot[3554]: {"ts": "2026-09-08T06:00:10.104Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1662gitlab # [ 339.254782] nixbot[3554]: {"ts": "2026-09-08T06:00:10.112Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1663gitlab # [ 339.259772] nixbot[3554]: {"ts": "2026-09-08T06:00:10.116Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1664gitlab # [ 339.263871] nixbot[3554]: {"ts": "2026-09-08T06:00:10.119Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1665gitlab # [ 339.267824] nixbot[3554]: {"ts": "2026-09-08T06:00:10.122Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1666gitlab # [ 339.271812] nixbot[3554]: {"ts": "2026-09-08T06:00:10.126Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1667gitlab # [ 339.275805] nixbot[3554]: {"ts": "2026-09-08T06:00:10.129Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1668gitlab # [ 339.279532] nixbot[3554]: {"ts": "2026-09-08T06:00:10.131Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1669gitlab # [ 339.283029] nixbot[3554]: {"ts": "2026-09-08T06:00:10.134Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1670gitlab # [ 339.301460] nixbot[3554]: {"ts": "2026-09-08T06:00:10.159Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1671gitlab # [ 339.311829] nixbot[3554]: {"ts": "2026-09-08T06:00:10.169Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1672gitlab # [ 339.315960] nixbot[3554]: {"ts": "2026-09-08T06:00:10.173Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1673gitlab # [ 339.320232] nixbot[3554]: {"ts": "2026-09-08T06:00:10.176Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1674gitlab # [ 339.327613] nixbot[3554]: {"ts": "2026-09-08T06:00:10.185Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "public_badges"}1675gitlab # [ 339.744919] nixbot[3554]: INFO: Started server process [3554]1676gitlab # [ 339.747656] nixbot[3554]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1677gitlab # [ 339.771998] nixbot[3554]: INFO: ::ffff:127.0.0.1:39818 - "GET /health HTTP/1.1" 200 OK1678gitlab # [ 339.778925] systemd[1]: Started nixbot CI service.1679gitlab # [ 339.779623] systemd[1]: Reached target Multi-User System.1680gitlab # [ 339.780435] systemd[1]: Startup finished in 815ms (kernel) + 4.209s (initrd) + 5min 34.754s (userspace) = 5min 39.778s.1681gitlab # [ 340.222997] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:11 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4491682gitlab # [ 340.231360] nixbot[3554]: {"ts": "2026-09-08T06:00:11.081Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1683gitlab # [ 340.259883] nixbot[3554]: {"ts": "2026-09-08T06:00:11.117Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1684gitlab # [ 340.356984] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 861685gitlab # [ 340.363373] nixbot[3554]: {"ts": "2026-09-08T06:00:11.216Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1686gitlab # [ 340.370541] nixbot[3554]: {"ts": "2026-09-08T06:00:11.220Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1687gitlab # [ 340.510999] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1431688gitlab # [ 340.517610] nixbot[3554]: {"ts": "2026-09-08T06:00:11.370Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1689gitlab: (finished: waiting for unit nixbot.service, in 2.15 seconds)1690gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1691gitlab # [ 340.754982] nixbot[3554]: INFO: ::ffff:127.0.0.1:39820 - "GET /health HTTP/1.1" 200 OK1692gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1693subtest: project discovered and webhook registered1694gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1695gitlab # [ 340.856296] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:11 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3311696gitlab # [ 340.858677] nixbot[3554]: {"ts": "2026-09-08T06:00:11.715Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1697gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds)1698(finished: subtest: project discovered and webhook registered, in 0.19 seconds)1699subtest: push delivers the webhook1700gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1701gitlab # [ 340.947055] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 1361702gitlab # [ 340.982887] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 1101703gitlab # [ 340.987870] nixbot[3554]: {"ts": "2026-09-08T06:00:11.840Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1704gitlab # [ 341.058229] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:11 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 651705gitlab # [ 341.065258] nixbot[3554]: {"ts": "2026-09-08T06:00:11.917Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1706gitlab # [ 341.186679] gitaly[910]: time="2026-09-08T06:00:12.043Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMHCJZWBZYB76EGWN0ESF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-08T06:00:42.017" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:00:12.018" grpc.time_ms=24.513 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1707gitlab # [ 341.242483] gitaly[910]: time="2026-09-08T06:00:12.100Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMHCJZWBZYB76EGWN0ESF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:00:42.097" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:00:12.098" grpc.time_ms=1.42 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1708gitlab # [ 341.275688] gitaly[910]: time="2026-09-08T06:00:12.125Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMHCJZWBZYB76EGWN0ESF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-08T06:00:22.006" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:00:12.107" grpc.time_ms=18.507 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1709gitlab # [ 341.316542] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2501710gitlab # [ 341.324757] nixbot[3554]: {"ts": "2026-09-08T06:00:12.175Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1711gitlab # [ 341.479013] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1541712gitlab # [ 341.486827] nixbot[3554]: {"ts": "2026-09-08T06:00:12.338Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1713gitlab # [ 341.495032] nixbot[3554]: {"ts": "2026-09-08T06:00:12.345Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1714gitlab # [ 341.688471] gitaly[910]: time="2026-09-08T06:00:12.546Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMHW4EP8KZ5MCFCSJ12Q7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:12.521" grpc.time_ms=24.404 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1715gitlab # [ 341.729651] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1281716gitlab # [ 341.883874] gitaly[910]: time="2026-09-08T06:00:12.741Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJ08KR5WQJW74KRFVZYC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:12.717" pid=910 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1717gitlab # [ 341.903712] gitaly[910]: time="2026-09-08T06:00:12.742Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=1 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJ08KR5WQJW74KRFVZYC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:12.717" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1718gitlab # [ 341.927638] gitlab-workhorse[815]: time="2026-09-08T06:00:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131719gitlab # [ 341.930720] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1931720gitlab # [ 341.933699] gitaly[910]: time="2026-09-08T06:00:12.743Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=1 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJ08KR5WQJW74KRFVZYC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:12.717" grpc.time_ms=25.466 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1721gitlab # [ 342.040368] gitaly[910]: time="2026-09-08T06:00:12.898Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJ6NFN8BHQMBCEQGJ6YZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:12.878" pid=910 remote_ip="2001:db8:1::1" request_sha=dad3d5ecdde665832bad199dc289d6d15988c1c0 response_bytes=223 span.kind=server system=grpc1722gitlab # [ 342.073050] gitaly[910]: time="2026-09-08T06:00:12.898Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJ6NFN8BHQMBCEQGJ6YZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:12.878" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1723gitlab # [ 342.104756] gitlab-workhorse[815]: time="2026-09-08T06:00:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231724gitlab # [ 342.110137] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1411725gitlab # [ 342.115120] gitaly[910]: time="2026-09-08T06:00:12.898Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJ6NFN8BHQMBCEQGJ6YZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:12.878" grpc.time_ms=19.542 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1726gitlab # [ 342.197096] gitaly[910]: time="2026-09-08T06:00:13.052Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMJD3R6MHGF2J90PVQHPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:13.037" grpc.time_ms=15.114 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1727gitlab # [ 342.225386] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 911728gitlab # [ 342.306007] gitaly[910]: time="2026-09-08T06:00:13.164Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJG0V6T1GN49C4828A7E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:13.144" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1729gitlab # [ 342.316313] gitaly[910]: time="2026-09-08T06:00:13.164Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJG0V6T1GN49C4828A7E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:13.144" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1730gitlab # [ 342.330938] gitlab-workhorse[815]: time="2026-09-08T06:00:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671731gitlab # [ 342.332808] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1091732gitlab # [ 342.334652] gitaly[910]: time="2026-09-08T06:00:13.166Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJG0V6T1GN49C4828A7E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:13.144" grpc.time_ms=20.586 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1733gitlab # [ 342.432530] gitaly[910]: time="2026-09-08T06:00:13.290Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMJND5R8TKT2X4D35QMKS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:13.271" grpc.time_ms=18.283 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1734gitlab # [ 342.469785] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 611735gitlab # [ 342.513499] gitaly[910]: time="2026-09-08T06:00:13.371Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJQFRC1RHMXHDRWKRDKH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:13.341" pid=910 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1736gitlab # [ 342.543444] gitaly[910]: time="2026-09-08T06:00:13.371Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJQFRC1RHMXHDRWKRDKH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:13.341" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1737gitlab # [ 342.575071] gitlab-workhorse[815]: time="2026-09-08T06:00:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091738gitlab # [ 342.578902] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 771739gitlab # [ 342.582459] gitaly[910]: time="2026-09-08T06:00:13.372Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJQFRC1RHMXHDRWKRDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:13.341" grpc.time_ms=30.249 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1740gitlab # [ 342.644784] gitaly[910]: time="2026-09-08T06:00:13.502Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:00:43.500" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:00:13.501" grpc.time_ms=1.168 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1741gitlab # [ 342.748950] gitaly[910]: time="2026-09-08T06:00:13.606Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=589 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-08T06:00:43.586" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:00:13.586" grpc.time_ms=19.836 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1742gitlab # [ 342.798494] gitaly[910]: time="2026-09-08T06:00:13.656Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:00:23.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:00:13.638" grpc.time_ms=17.96 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1743gitlab # [ 342.869607] gitaly[910]: time="2026-09-08T06:00:13.727Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:00:23.079" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:00:13.709" grpc.time_ms=17.449 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744gitlab # [ 343.070226] gitaly[910]: time="2026-09-08T06:00:13.926Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T06:00:23.071" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:00:13.922" grpc.time_ms=1.501 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 343.103898] gitaly[910]: time="2026-09-08T06:00:13.961Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T06:00:23.091" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:00:13.942" grpc.time_ms=19.285 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1746gitlab # [ 343.157552] gitaly[910]: time="2026-09-08T06:00:14.015Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:00:14.014" grpc.time_ms=0.511 pid=910 span.kind=server system=grpc1747gitlab # [ 343.188585] gitaly[910]: time="2026-09-08T06:00:14.046Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:00:14.046" grpc.time_ms=0.478 pid=910 span.kind=server system=grpc1748gitlab # [ 343.213808] gitaly[910]: time="2026-09-08T06:00:14.055Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ diskcache=8f0a1cce-f53f-4363-b5d4-f697f2aeb2e8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T06:00:23.115" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:00:13.966" pid=910 ref=refs/keep-around/5009dc57e8e224fa1aafc1cbf6a041831968d342 remote_ip="2001:db8:1::1" revision=5009dc57e8e224fa1aafc1cbf6a041831968d342 span.kind=server system=grpc username=root1749gitlab # [ 343.235112] gitaly[910]: time="2026-09-08T06:00:14.055Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=71 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5239 command.oublock=8 command.real_time_ms=82 command.spawn_token_fork_ms=2 command.system_time_ms=43 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T06:00:23.115" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:00:13.966" grpc.time_ms=89.211 pid=910 ref=refs/keep-around/5009dc57e8e224fa1aafc1cbf6a041831968d342 remote_ip="2001:db8:1::1" revision=5009dc57e8e224fa1aafc1cbf6a041831968d342 span.kind=server system=grpc username=root1750gitlab # [ 343.256351] gitaly[910]: time="2026-09-08T06:00:14.059Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:00:44.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:00:14.058" grpc.time_ms=0.326 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1751gitlab # [ 343.385935] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 8011752gitlab # [ 343.388851] nixbot[3554]: {"ts": "2026-09-08T06:00:14.246Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 \"HTTP/1.1 201 Created\""}1753gitlab # [ 343.404263] nixbot[3554]: {"ts": "2026-09-08T06:00:14.262Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-5009dc57e8e2-0"}1754gitlab # [ 343.699174] nixbot[3554]: {"ts": "2026-09-08T06:00:14.557Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-5009dc57e8e2-0", "argv0": "bwrap"}1755gitlab # [ 343.886718] systemd[1]: Started Nix Daemon.1756gitlab # [ 344.018548] nix-daemon[3721]: accepted connection from pid 3716, user nixbot1757gitlab # [ 347.996532] nix-daemon[3721]: accepted connection from pid 3763, user nixbot1758gitlab # [ 348.020256] nix-daemon[3721]: accepted connection from pid 3716, user nixbot1759gitlab # [ 352.226779] nix-daemon[3721]: accepted connection from pid 3716, user nixbot1760gitlab # [ 352.661128] gitaly[910]: time="2026-09-08T06:00:23.517Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMWC5K843T6Y8MZK9QK23 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:00:53.515" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:00:23.516" grpc.time_ms=1.356 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 352.739000] gitaly[910]: time="2026-09-08T06:00:23.596Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMWC5K843T6Y8MZK9QK23 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:00:33.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:00:23.577" grpc.time_ms=19.055 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 352.910933] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 5931763gitlab # [ 352.920096] nixbot[3554]: {"ts": "2026-09-08T06:00:23.770Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 \"HTTP/1.1 201 Created\""}1764gitlab # [ 353.016216] gitaly[910]: time="2026-09-08T06:00:23.874Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMWZ3C93R5KR3DS37EY9S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:00:53.871" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:00:23.872" grpc.time_ms=1.168 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 353.082656] gitaly[910]: time="2026-09-08T06:00:23.940Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMWZ3C93R5KR3DS37EY9S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:00:33.290" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:00:23.920" grpc.time_ms=19.437 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 353.186033] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2641767gitlab # [ 353.194102] nixbot[3554]: {"ts": "2026-09-08T06:00:24.045Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 \"HTTP/1.1 201 Created\""}1768gitlab # [ 353.312982] gitaly[910]: time="2026-09-08T06:00:24.171Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMX7Z9PQ1XN3XM6Y4GCAJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:00:54.069" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:00:24.169" grpc.time_ms=1.069 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 353.509867] gitaly[910]: time="2026-09-08T06:00:24.367Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMX7Z9PQ1XN3XM6Y4GCAJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:00:34.300" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:00:24.351" grpc.time_ms=16.546 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 353.720640] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 5141771gitlab # [ 353.730014] nixbot[3554]: {"ts": "2026-09-08T06:00:24.580Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 \"HTTP/1.1 201 Created\""}1772gitlab # [ 354.335344] gitaly[910]: time="2026-09-08T06:00:25.192Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=4 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMY81PNBH7D11TZJJBMJ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:25.171" grpc.time_ms=20.802 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1773gitlab # [ 354.373635] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1031774gitlab # [ 354.483229] gitaly[910]: time="2026-09-08T06:00:25.341Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMYBB5YYGRWZSTQJGB642 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:25.321" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1775gitlab # [ 354.511606] gitaly[910]: time="2026-09-08T06:00:25.341Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMYBB5YYGRWZSTQJGB642 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:25.321" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1776gitlab # [ 354.538314] gitlab-workhorse[815]: time="2026-09-08T06:00:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671777gitlab # [ 354.541310] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1461778gitlab # [ 354.544085] gitaly[910]: time="2026-09-08T06:00:25.341Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMYBB5YYGRWZSTQJGB642 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:25.321" grpc.time_ms=20.409 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1779gitlab # [ 354.641049] gitaly[910]: time="2026-09-08T06:00:25.499Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMYJFAFF038DK60PC9D39 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:25.488" grpc.time_ms=10.804 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1780gitlab # [ 354.654385] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 791781gitlab # [ 354.727129] gitaly[910]: time="2026-09-08T06:00:25.585Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMYN1QM3J91KSXMG4ZDDR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:25.568" pid=910 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1782gitlab # [ 354.739578] gitaly[910]: time="2026-09-08T06:00:25.585Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMYN1QM3J91KSXMG4ZDDR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:25.568" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1783gitlab # [ 354.754903] gitlab-workhorse[815]: time="2026-09-08T06:00:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671784gitlab # [ 354.756905] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:00:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 801785gitlab # [ 354.758886] gitaly[910]: time="2026-09-08T06:00:25.585Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMYN1QM3J91KSXMG4ZDDR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:00:25.568" grpc.time_ms=16.705 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1786gitlab # [ 368.978388] sidekiq-cluster[3409]: 2026-09-08T06:00:39.835Z pid=3409 tid=yrd INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3409, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431837184}1787gitlab # [ 369.272185] sidekiq-cluster[3409]: W, [2026-09-08T06:00:40.130012 #3409] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1788gitlab # [ 369.336897] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:00:40.194Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1789gitlab # [ 372.842410] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:00:43.699Z","message":"GitLab reliable fetch activated!"}1790gitlab # [ 372.842769] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:00:43.699Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1791gitlab # [ 410.774911] postgres[4269]: [4269] ERROR: relation "table_without_models" does not exist1792gitlab # [ 410.775497] postgres[4269]: [4269] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1793gitlab # [ 413.589980] sidekiq-cluster[3409]: InitializerConnections Query: SET client_min_messages TO 'warning'1794gitlab # [ 413.590369] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1795gitlab # [ 413.590493] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1796gitlab # [ 413.590631] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1797gitlab # [ 413.590744] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1798gitlab # [ 413.590858] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1799gitlab # [ 413.590969] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1800gitlab # [ 413.591083] sidekiq-cluster[3409]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1801gitlab # [ 413.609040] sidekiq-cluster[3409]: InitializerConnections Query: SET standard_conforming_strings = on1802gitlab # [ 413.626218] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1803gitlab # [ 413.630613] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1804gitlab # [ 413.634413] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1805gitlab # [ 413.638472] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1806gitlab # [ 413.642106] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1807gitlab # [ 413.645825] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1808gitlab # [ 413.650506] sidekiq-cluster[3409]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1809gitlab # [ 413.771354] sidekiq-cluster[3409]: InitializerConnections Query: SET intervalstyle = iso_86011810gitlab # [ 413.775000] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1811gitlab # [ 413.779396] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1812gitlab # [ 413.783211] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1813gitlab # [ 413.787312] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1814gitlab # [ 413.791034] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1815gitlab # [ 413.794767] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1816gitlab # [ 413.799419] sidekiq-cluster[3409]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1817gitlab # [ 414.009955] sidekiq-cluster[3409]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1818gitlab # [ 414.015672] sidekiq-cluster[3409]: FROM pg_type as t1819gitlab # [ 414.017888] sidekiq-cluster[3409]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1820gitlab # [ 414.023234] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1821gitlab # [ 414.027662] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1822gitlab # [ 414.031527] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1823gitlab # [ 414.035674] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1824gitlab # [ 414.039378] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1825gitlab # [ 414.043093] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1826gitlab # [ 414.047743] sidekiq-cluster[3409]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1827gitlab # [ 414.092733] sidekiq-cluster[3409]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1828gitlab # [ 414.096189] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1829gitlab # [ 414.100489] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1830gitlab # [ 414.104186] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1831gitlab # [ 414.108149] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1832gitlab # [ 414.111713] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1833gitlab # [ 414.115494] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1834gitlab # [ 414.120257] sidekiq-cluster[3409]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1835gitlab # [ 414.143432] sidekiq-cluster[3409]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'sidekiq_throttling_middleware'1836gitlab # [ 414.153251] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1837gitlab # [ 414.157556] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1838gitlab # [ 414.161034] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1839gitlab # [ 414.164667] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1840gitlab # [ 414.167637] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1841gitlab # [ 414.170847] sidekiq-cluster[3409]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1842gitlab # [ 414.174969] sidekiq-cluster[3409]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1843gitlab # [ 415.804664] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:26.662Z","message":"Booted Rails 7.2.3.1 application in production environment"}1844gitlab # [ 415.806623] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:26.662Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1845gitlab # [ 415.812685] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:26.670Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1846gitlab # [ 415.815554] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:26.673Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1847gitlab # [ 415.821991] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:26.675Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1848gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 75.39 seconds)1849gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1850gitlab # [ 416.547954] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:27 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1151851gitlab # [ 416.674431] gitaly[910]: time="2026-09-08T06:01:27.531Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV3EZEHJG2MMTPRRRB0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:27.512" grpc.time_ms=19.473 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1852gitlab # Enumerating objects: 5, done.1853gitlab # [ 416.694774] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:27 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1261854gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1855gitlab # Delta compression using up to 4 threads1856gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1857gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 68.00 KiB/s, done.1858gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1859gitlab # [ 417.277556] gitaly[910]: time="2026-09-08T06:01:28.135Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=300 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=4 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-08T06:01:58.008" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-08T06:01:28.108" grpc.time_ms=26.419 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1860gitlab # [ 417.373332] gitaly[910]: time="2026-09-08T06:01:28.231Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M duration_ms=326ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/allowed"1861gitlab # [ 417.430665] gitaly[910]: time="2026-09-08T06:01:28.288Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M duration_ms=56ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/pre_receive"1862gitlab # [ 417.444367] gitaly[910]: time="2026-09-08T06:01:28.288Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:27.902" grpc.time_ms=385.907 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1863gitlab # [ 417.507331] gitaly[910]: time="2026-09-08T06:01:28.365Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:28.363" grpc.time_ms=1.349 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1864gitlab # [ 417.594552] gitaly[910]: time="2026-09-08T06:01:28.452Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:28.451" grpc.time_ms=0.889 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1865gitlab # [ 417.653055] gitaly[910]: time="2026-09-08T06:01:28.511Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:28.506" grpc.time_ms=3.992 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1866gitlab # [ 417.836347] gitaly[910]: time="2026-09-08T06:01:28.693Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M duration_ms=124ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/post_receive"1867gitlab # [ 417.845446] gitaly[910]: time="2026-09-08T06:01:28.694Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:28.566" grpc.time_ms=127.974 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1868gitlab # To http://gitlab/root/test-flake.git1869gitlab # [ 417.877901] gitaly[910]: time="2026-09-08T06:01:28.712Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M diskcache=2044dd70-0221-475d-a500-92ca0eb80698 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:27.787" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1870gitlab # 5009dc5..4473f91 master -> master[ 417.902776] gitlab-workhorse[815]: time="2026-09-08T06:01:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521871gitlab # 1872gitlab # [ 417.906489] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:28 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 11311873gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.58 seconds)1874gitlab: must succeed: git -C /tmp/test-flake rev-parse master1875gitlab # [ 417.910045] gitaly[910]: time="2026-09-08T06:01:28.713Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=396 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13471 command.oublock=32 command.real_time_ms=917 command.spawn_token_fork_ms=2 command.system_time_ms=258 command.user_time_ms=138 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:27.787" grpc.time_ms=924.914 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1876gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1877gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca'1878gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca', in 0.14 seconds)1879gitlab # [ 418.078561] nixbot[3554]: INFO: ::ffff:127.0.0.1:60156 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 200 OK1880gitlab # [ 418.482808] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:29.339Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8cdd6944eb97e6453e5f58fa","created_at":"2026-09-08T05:59:56.220Z","trace_propagation_headers":{"sentry-trace":"ff4b7cea618046f494541f2a2c1c2c2c-89b663fa67e544d8","baggage":"sentry-trace_id=ff4b7cea618046f494541f2a2c1c2c2c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSM0S9BSKDJ7NB3DTYZ499","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:56.271Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8cdd6944eb97e6453e5f58fa: start","job_status":"start","queue_duration_s":93.067861,"scheduling_latency_s":93.067917}1881gitlab # [ 418.815604] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:29.672Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8cdd6944eb97e6453e5f58fa","created_at":"2026-09-08T05:59:56.220Z","trace_propagation_headers":{"sentry-trace":"ff4b7cea618046f494541f2a2c1c2c2c-89b663fa67e544d8","baggage":"sentry-trace_id=ff4b7cea618046f494541f2a2c1c2c2c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSM0S9BSKDJ7NB3DTYZ499","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:56.271Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8cdd6944eb97e6453e5f58fa: done: 0.333065 sec","job_status":"done","queue_duration_s":93.067861,"scheduling_latency_s":93.067917,"redis_calls":23,"redis_duration_s":0.009115999999999999,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.004717,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002615,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.19656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19359332,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.333065,"completed_at":"2026-09-08T06:01:29.672Z","load_balancing_strategy":"primary","db_duration_s":0.096005,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1882gitlab # [ 418.931129] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:29.676Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"8cf5e52a98ad209c7881c237","created_at":"2026-09-08T05:59:56.289Z","trace_propagation_headers":{"sentry-trace":"ff4b7cea618046f494541f2a2c1c2c2c-89b663fa67e544d8","baggage":"sentry-trace_id=ff4b7cea618046f494541f2a2c1c2c2c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSM0S9BSKDJ7NB3DTYZ499","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:56.296Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-8cf5e52a98ad209c7881c237: start","job_status":"start","queue_duration_s":93.380196,"scheduling_latency_s":93.380237}1883gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca'1884gitlab # [ 419.006767] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:29.864Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"8cf5e52a98ad209c7881c237","created_at":"2026-09-08T05:59:56.289Z","trace_propagation_headers":{"sentry-trace":"ff4b7cea618046f494541f2a2c1c2c2c-89b663fa67e544d8","baggage":"sentry-trace_id=ff4b7cea618046f494541f2a2c1c2c2c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSM0S9BSKDJ7NB3DTYZ499","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:56.296Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-8cf5e52a98ad209c7881c237: done: 0.18776 sec","job_status":"done","queue_duration_s":93.380196,"scheduling_latency_s":93.380237,"redis_calls":14,"redis_duration_s":0.005025,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001376,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002114,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001535,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.138501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14323694,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.18776,"completed_at":"2026-09-08T06:01:29.864Z","load_balancing_strategy":"primary","db_duration_s":0.037695,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1885gitlab # [ 419.105617] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:29.866Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"abcbcb0e7113e3dc99ae2638","created_at":"2026-09-08T05:59:57.085Z","trace_propagation_headers":{"sentry-trace":"ff4b7cea618046f494541f2a2c1c2c2c-89b663fa67e544d8","baggage":"sentry-trace_id=ff4b7cea618046f494541f2a2c1c2c2c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSM0S9BSKDJ7NB3DTYZ499","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:57.095Z","job_size_bytes":5,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-abcbcb0e7113e3dc99ae2638: start","job_status":"start","queue_duration_s":92.771404,"scheduling_latency_s":92.771454}1886gitlab # [ 419.133600] nixbot[3554]: INFO: ::ffff:127.0.0.1:60166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 200 OK1887gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca', in 0.06 seconds)1888gitlab # [ 419.237526] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:30.095Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"abcbcb0e7113e3dc99ae2638","created_at":"2026-09-08T05:59:57.085Z","trace_propagation_headers":{"sentry-trace":"ff4b7cea618046f494541f2a2c1c2c2c-89b663fa67e544d8","baggage":"sentry-trace_id=ff4b7cea618046f494541f2a2c1c2c2c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSM0S9BSKDJ7NB3DTYZ499","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:57.095Z","job_size_bytes":5,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-abcbcb0e7113e3dc99ae2638: done: 0.228445 sec","job_status":"done","queue_duration_s":92.771404,"scheduling_latency_s":92.771454,"redis_calls":12,"redis_duration_s":0.003407,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000873,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002022,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.179879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036226,"duration_s":0.228445,"completed_at":"2026-09-08T06:01:30.095Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040967,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1889gitlab # [ 419.345040] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:30.097Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"71bf417037d98de0ae10a7b4","created_at":"2026-09-08T05:59:57.135Z","trace_propagation_headers":{"sentry-trace":"ff4b7cea618046f494541f2a2c1c2c2c-89b663fa67e544d8","baggage":"sentry-trace_id=ff4b7cea618046f494541f2a2c1c2c2c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSM0S9BSKDJ7NB3DTYZ499","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:57.143Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-71bf417037d98de0ae10a7b4: start","job_status":"start","queue_duration_s":92.953993,"scheduling_latency_s":92.954014}1890gitlab # [ 419.652147] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:30.508Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"71bf417037d98de0ae10a7b4","created_at":"2026-09-08T05:59:57.135Z","trace_propagation_headers":{"sentry-trace":"ff4b7cea618046f494541f2a2c1c2c2c-89b663fa67e544d8","baggage":"sentry-trace_id=ff4b7cea618046f494541f2a2c1c2c2c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSM0S9BSKDJ7NB3DTYZ499","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:57.143Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-71bf417037d98de0ae10a7b4: done: 0.411411 sec","job_status":"done","queue_duration_s":92.953993,"scheduling_latency_s":92.954014,"redis_calls":11,"redis_duration_s":0.0034939999999999997,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000737,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002054,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000703,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.349,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.349,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.300543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009013,"duration_s":0.411411,"completed_at":"2026-09-08T06:01:30.508Z","load_balancing_strategy":"primary","db_duration_s":0.121909,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1891gitlab # [ 419.758463] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:30.511Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"ab535867aefa1012203e1a35","created_at":"2026-09-08T05:59:57.148Z","trace_propagation_headers":{"sentry-trace":"ff4b7cea618046f494541f2a2c1c2c2c-89b663fa67e544d8","baggage":"sentry-trace_id=ff4b7cea618046f494541f2a2c1c2c2c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSM0S9BSKDJ7NB3DTYZ499","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:57.154Z","job_size_bytes":89,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-ab535867aefa1012203e1a35: start","job_status":"start","queue_duration_s":93.356582,"scheduling_latency_s":93.356616}1892gitlab # [ 419.780745] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:30.572Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"ab535867aefa1012203e1a35","created_at":"2026-09-08T05:59:57.148Z","trace_propagation_headers":{"sentry-trace":"ff4b7cea618046f494541f2a2c1c2c2c-89b663fa67e544d8","baggage":"sentry-trace_id=ff4b7cea618046f494541f2a2c1c2c2c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSM0S9BSKDJ7NB3DTYZ499","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-08T05:59:57.154Z","job_size_bytes":89,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-ab535867aefa1012203e1a35: done: 0.061577 sec","job_status":"done","queue_duration_s":93.356582,"scheduling_latency_s":93.356616,"redis_calls":11,"redis_duration_s":0.003789,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001011,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00066,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006269,"duration_s":0.061577,"completed_at":"2026-09-08T06:01:30.572Z","load_balancing_strategy":"primary","db_duration_s":0.00887,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1893gitlab # [ 419.827181] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:30.575Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 5009dc57e8e224fa1aafc1cbf6a041831968d342 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7fd96d2165a90c4f61e293bc","created_at":"2026-09-08T06:00:08.423Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-7c56c25e3a344ff6","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:00:08.433Z","job_size_bytes":185,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7fd96d2165a90c4f61e293bc: start","job_status":"start","queue_duration_s":82.142183,"scheduling_latency_s":82.142213}1894gitlab # [ 419.844307] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:30.598Z","message":"changes: \"0000000000000000000000000000000000000000 5009dc57e8e224fa1aafc1cbf6a041831968d342 refs/heads/master\\n\""}1895gitlab # [ 419.846989] gitaly[910]: time="2026-09-08T06:01:30.653Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:40.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:30.636" grpc.time_ms=17.08 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1896gitlab # [ 419.859868] gitaly[910]: time="2026-09-08T06:01:30.681Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T06:01:40.033" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:01:30.663" grpc.time_ms=17.171 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1897gitlab # [ 419.933380] gitaly[910]: time="2026-09-08T06:01:30.791Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-08T06:01:40.141" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:30.772" grpc.time_ms=18.763 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1898gitlab # [ 420.007876] gitaly[910]: time="2026-09-08T06:01:30.865Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:30.864" grpc.time_ms=0.891 pid=910 span.kind=server system=grpc1899gitlab # [ 420.062038] gitaly[910]: time="2026-09-08T06:01:30.920Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:30.919" grpc.time_ms=0.76 pid=910 span.kind=server system=grpc1900gitlab # [ 420.083673] gitaly[910]: time="2026-09-08T06:01:30.933Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 diskcache=8460fafe-9bc5-4c06-9137-f716581006e9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T06:01:40.183" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:01:30.813" pid=910 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1901gitlab # [ 420.103316] gitaly[910]: time="2026-09-08T06:01:30.934Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=129 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4954 command.oublock=8 command.real_time_ms=113 command.spawn_token_fork_ms=1 command.system_time_ms=65 command.user_time_ms=64 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T06:01:40.183" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:01:30.813" grpc.time_ms=120.017 pid=910 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1902gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca'1903gitlab # [ 420.125628] gitaly[910]: time="2026-09-08T06:01:30.968Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T06:01:40.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:01:30.967" grpc.time_ms=0.331 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1904gitlab # [ 420.145723] gitaly[910]: time="2026-09-08T06:01:31.003Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=858 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=21 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-08T06:01:40.016" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:30.977" grpc.time_ms=26.11 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905gitlab # [ 420.196122] nixbot[3554]: INFO: ::ffff:127.0.0.1:60172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 200 OK1906gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca', in 0.06 seconds)1907gitlab # [ 420.331039] gitaly[910]: time="2026-09-08T06:01:31.189Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-08T06:02:01.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:31.176" grpc.time_ms=12.101 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908gitlab # [ 420.392345] gitaly[910]: time="2026-09-08T06:01:31.250Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T06:01:41.009" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:01:31.249" grpc.time_ms=0.557 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1909gitlab # [ 420.424211] gitaly[910]: time="2026-09-08T06:01:31.266Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-08T06:01:41.014" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-08T06:01:31.254" grpc.time_ms=11.568 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1910gitlab # [ 420.455014] gitaly[910]: time="2026-09-08T06:01:31.311Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:41.053" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:31.293" grpc.time_ms=17.713 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1911gitlab # [ 420.482111] gitaly[910]: time="2026-09-08T06:01:31.340Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:41.082" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:31.323" grpc.time_ms=16.951 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1912gitlab # [ 420.523927] gitaly[910]: time="2026-09-08T06:01:31.381Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=879 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-08T06:02:01.253" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:31.354" grpc.time_ms=27.742 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1913gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca'1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca', in 0.05 seconds)1915gitlab # [ 421.252598] nixbot[3554]: INFO: ::ffff:127.0.0.1:34208 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 200 OK1916gitlab # [ 421.293422] gitaly[910]: time="2026-09-08T06:01:32.150Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-08T06:01:42.006" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:32.146" grpc.time_ms=3.227 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1917gitlab # [ 421.363372] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:32.219Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 5009dc57e8e224fa1aafc1cbf6a041831968d342 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7fd96d2165a90c4f61e293bc","created_at":"2026-09-08T06:00:08.423Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-7c56c25e3a344ff6","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:00:08.433Z","job_size_bytes":185,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7fd96d2165a90c4f61e293bc: done: 1.643886 sec","job_status":"done","queue_duration_s":82.142183,"scheduling_latency_s":82.142213,"gitaly_calls":13,"gitaly_duration_s":0.349332,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.07092,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.007834,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009218,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002689,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005617,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.029786,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015776,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.089,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.33,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.379,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.089,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.148583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0009534,"exclusive_lock_hold_duration_s":0.04343004,"duration_s":1.643886,"completed_at":"2026-09-08T06:01:32.219Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.158298,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1918gitlab # [ 421.460396] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:32.222Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"97b0b531f83b6dbc8b6a9a37","created_at":"2026-09-08T06:00:14.066Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-5c239abc7463475a","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-08T06:00:14.074Z","job_size_bytes":65,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-97b0b531f83b6dbc8b6a9a37: start","job_status":"start","queue_duration_s":78.147997,"scheduling_latency_s":78.148037}1919gitlab # [ 421.514884] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:32.371Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"97b0b531f83b6dbc8b6a9a37","created_at":"2026-09-08T06:00:14.066Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-5c239abc7463475a","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-08T06:00:14.074Z","job_size_bytes":65,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-97b0b531f83b6dbc8b6a9a37: done: 0.149664 sec","job_status":"done","queue_duration_s":78.147997,"scheduling_latency_s":78.148037,"redis_calls":16,"redis_duration_s":0.006109,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003171,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002141,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000797,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070432,"duration_s":0.149664,"completed_at":"2026-09-08T06:01:32.371Z","load_balancing_strategy":"primary","db_duration_s":0.036816,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1920gitlab # [ 421.615615] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:32.374Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b99b339f127be3680bfa2fea","created_at":"2026-09-08T06:00:14.076Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-5c239abc7463475a","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-08T06:00:14.082Z","job_size_bytes":65,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b99b339f127be3680bfa2fea: start","job_status":"start","queue_duration_s":78.292024,"scheduling_latency_s":78.292056}1921gitlab # [ 421.811651] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:32.669Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b99b339f127be3680bfa2fea","created_at":"2026-09-08T06:00:14.076Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-5c239abc7463475a","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-08T06:00:14.082Z","job_size_bytes":65,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b99b339f127be3680bfa2fea: done: 0.294269 sec","job_status":"done","queue_duration_s":78.292024,"scheduling_latency_s":78.292056,"redis_calls":21,"redis_duration_s":0.006869,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003271,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001853,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.229871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003407,"duration_s":0.294269,"completed_at":"2026-09-08T06:01:32.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1922gitlab # [ 421.905812] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:32.671Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5ab493a70563a1bb2ab33323","created_at":"2026-09-08T06:00:14.217Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-5c239abc7463475a","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T06:00:14.224Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5ab493a70563a1bb2ab33323: start","job_status":"start","queue_duration_s":78.447325,"scheduling_latency_s":78.44735}1923gitlab # [ 422.038891] gitaly[910]: time="2026-09-08T06:01:32.896Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:32.895" grpc.time_ms=1.353 pid=910 span.kind=server system=grpc1924gitlab # [ 422.085172] gitaly[910]: time="2026-09-08T06:01:32.943Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:32.942" grpc.time_ms=1.029 pid=910 span.kind=server system=grpc1925gitlab # [ 422.136190] gitaly[910]: time="2026-09-08T06:01:32.994Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:32.992" grpc.time_ms=1.563 pid=910 span.kind=server system=grpc1926gitlab # [ 422.166999] gitaly[910]: time="2026-09-08T06:01:33.007Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ diskcache=47d86236-41a6-4496-b32e-e233da7cc6be grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T06:02:02.737" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:32.838" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927gitlab # [ 422.192227] gitaly[910]: time="2026-09-08T06:01:33.007Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=195 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7569 command.oublock=0 command.real_time_ms=162 command.spawn_token_fork_ms=1 command.system_time_ms=122 command.user_time_ms=73 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T06:02:02.737" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:32.838" grpc.time_ms=169.2 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1928gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca'1929gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca', in 0.06 seconds)1930gitlab # [ 422.316517] nixbot[3554]: INFO: ::ffff:127.0.0.1:34220 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 200 OK1931gitlab # [ 422.414586] gitaly[910]: time="2026-09-08T06:01:33.271Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T06:02:03.169" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:33.269" grpc.time_ms=1.763 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932gitlab # [ 422.486766] gitaly[910]: time="2026-09-08T06:01:33.344Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMJW1TPWP8R5RZ5MJGQSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:03.242" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:33.343" grpc.time_ms=1.507 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 422.532777] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:33.389Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5ab493a70563a1bb2ab33323","created_at":"2026-09-08T06:00:14.217Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-5c239abc7463475a","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T06:00:14.224Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5ab493a70563a1bb2ab33323: done: 0.717424 sec","job_status":"done","queue_duration_s":78.447325,"scheduling_latency_s":78.44735,"gitaly_calls":3,"gitaly_duration_s":0.183554,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.045799,"redis_read_bytes":455,"redis_write_bytes":28002,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00152,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002102,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.015798,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.00867,"redis_queues_read_bytes":34,"redis_queues_write_bytes":14496,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.011139,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000684,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000909,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003457,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.027,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.032,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.047,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.409122,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.62817574,"duration_s":0.717424,"completed_at":"2026-09-08T06:01:33.389Z","load_balancing_strategy":"primary","db_duration_s":0.11239,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1934gitlab # [ 422.615326] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:33.392Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","5009dc57e8e224fa1aafc1cbf6a041831968d342 4473f91e6d2f683dd5adcb9621434f2b014dabca refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"e033c9cddd6224ce7164cfa7","created_at":"2026-09-08T06:01:28.637Z","trace_propagation_headers":{"sentry-trace":"5eeb346bf5c64d88ab6ba8235be79097-0b922844d9be49bf","baggage":"sentry-trace_id=5eeb346bf5c64d88ab6ba8235be79097,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:28.643Z","job_size_bytes":185,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-e033c9cddd6224ce7164cfa7: start","job_status":"start","queue_duration_s":4.74929,"scheduling_latency_s":4.749338}1935gitlab # [ 422.634496] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:33.417Z","message":"changes: \"5009dc57e8e224fa1aafc1cbf6a041831968d342 4473f91e6d2f683dd5adcb9621434f2b014dabca refs/heads/master\\n\""}1936gitlab # [ 422.637087] gitaly[910]: time="2026-09-08T06:01:33.477Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:43.218" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:33.458" grpc.time_ms=18.223 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab # [ 422.649907] gitaly[910]: time="2026-09-08T06:01:33.503Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T06:01:43.246" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:01:33.486" grpc.time_ms=16.564 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938gitlab # [ 422.663213] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:33.513Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"bd042ba074fe3830de9f786f","created_at":"2026-09-08T06:01:33.508Z","trace_propagation_headers":{"sentry-trace":"5eeb346bf5c64d88ab6ba8235be79097-135116b058604620","baggage":"sentry-trace_id=5eeb346bf5c64d88ab6ba8235be79097,sentry-release=Unknown"},"correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"b39eb8716114fa070dde56bb","job_size_bytes":46,"pid":3409,"job_status":"deduplicated","message":"ProjectCacheWorker JID-bd042ba074fe3830de9f786f: deduplicated: until executing","deduplication.type":"until executing"}1939gitlab # [ 422.696872] gitaly[910]: time="2026-09-08T06:01:33.554Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-08T06:01:43.296" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:33.537" grpc.time_ms=17.544 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab # [ 422.724189] gitaly[910]: time="2026-09-08T06:01:33.582Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-08T06:02:03.462" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:33.563" grpc.time_ms=18.947 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 422.762338] gitaly[910]: time="2026-09-08T06:01:33.614Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-08T06:01:43.002" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-08T06:01:33.603" grpc.time_ms=10.852 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1942gitlab # [ 422.790838] gitaly[910]: time="2026-09-08T06:01:33.648Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:43.031" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:33.632" grpc.time_ms=16.571 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943gitlab # [ 422.961144] gitaly[910]: time="2026-09-08T06:01:33.819Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-08T06:01:43.216" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:33.816" grpc.time_ms=2.172 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1944gitlab # [ 423.005722] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:33.862Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","5009dc57e8e224fa1aafc1cbf6a041831968d342 4473f91e6d2f683dd5adcb9621434f2b014dabca refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"e033c9cddd6224ce7164cfa7","created_at":"2026-09-08T06:01:28.637Z","trace_propagation_headers":{"sentry-trace":"5eeb346bf5c64d88ab6ba8235be79097-0b922844d9be49bf","baggage":"sentry-trace_id=5eeb346bf5c64d88ab6ba8235be79097,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:28.643Z","job_size_bytes":185,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-e033c9cddd6224ce7164cfa7: done: 0.470468 sec","job_status":"done","queue_duration_s":4.74929,"scheduling_latency_s":4.749338,"gitaly_calls":7,"gitaly_duration_s":0.131971,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.037791,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.004116,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001519,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004987,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.013074,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.014095,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.045,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.045,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.295139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0018119,"exclusive_lock_hold_duration_s":0.0385843,"duration_s":0.470468,"completed_at":"2026-09-08T06:01:33.862Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04161,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1945gitlab # [ 423.099263] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:33.865Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b39eb8716114fa070dde56bb","created_at":"2026-09-08T06:01:30.686Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-da46eb43800644d0","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:30.722Z","job_size_bytes":46,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b39eb8716114fa070dde56bb: start","job_status":"start","queue_duration_s":3.143496,"scheduling_latency_s":3.143531}1946gitlab # [ 423.116648] gitaly[910]: time="2026-09-08T06:01:33.944Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-08T12:01:33.933" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:01:33.933" grpc.time_ms=9.849 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1947gitlab # [ 423.127496] gitaly[910]: time="2026-09-08T06:01:33.971Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-08T06:02:03.854" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:33.954" grpc.time_ms=16.58 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 423.170968] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:34.028Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b39eb8716114fa070dde56bb","created_at":"2026-09-08T06:01:30.686Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-da46eb43800644d0","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:30.722Z","job_size_bytes":46,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b39eb8716114fa070dde56bb: done: 0.162485 sec","job_status":"done","queue_duration_s":3.143496,"scheduling_latency_s":3.143531,"gitaly_calls":2,"gitaly_duration_s":0.032436,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010966,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.00254,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000934,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002439,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003992,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061224,"duration_s":0.162485,"completed_at":"2026-09-08T06:01:34.028Z","load_balancing_strategy":"primary","db_duration_s":0.01708,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1949gitlab # [ 423.245342] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:34.031Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ea0257e08ad78c45df82ae2c","created_at":"2026-09-08T06:01:30.753Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-da46eb43800644d0","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:30.763Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ea0257e08ad78c45df82ae2c: start","job_status":"start","queue_duration_s":3.267194,"scheduling_latency_s":3.267229}1950gitlab # [ 423.267801] gitaly[910]: time="2026-09-08T06:01:34.110Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 diskcache=7dee4d29-3069-4ed1-9583-8102a991e129 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T12:01:34.070" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:34.071" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951gitlab # [ 423.280069] gitaly[910]: time="2026-09-08T06:01:34.111Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=48 command.spawn_token_fork_ms=3 command.system_time_ms=28 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T12:01:34.070" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:34.071" grpc.time_ms=39.276 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca'1953gitlab # [ 423.322740] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:34.180Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ea0257e08ad78c45df82ae2c","created_at":"2026-09-08T06:01:30.753Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-da46eb43800644d0","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:30.763Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ea0257e08ad78c45df82ae2c: done: 0.149039 sec","job_status":"done","queue_duration_s":3.267194,"scheduling_latency_s":3.267229,"gitaly_calls":1,"gitaly_duration_s":0.042722,"redis_calls":15,"redis_duration_s":0.005378,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000562,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002046,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000848,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001922,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.018,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.035,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10476014,"duration_s":0.149039,"completed_at":"2026-09-08T06:01:34.180Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1954gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca', in 0.07 seconds)1955gitlab # [ 423.385136] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:34.182Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"9eb25b80e2e35b77ce3f346f","created_at":"2026-09-08T06:01:30.958Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-da46eb43800644d0","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:30.962Z","job_size_bytes":23,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9eb25b80e2e35b77ce3f346f: start","job_status":"start","queue_duration_s":3.219854,"scheduling_latency_s":3.219887}1956gitlab # [ 423.401814] nixbot[3554]: INFO: ::ffff:127.0.0.1:34236 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 200 OK1957gitlab # [ 423.408121] gitaly[910]: time="2026-09-08T06:01:34.266Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-08T06:02:04.147" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:34.247" grpc.time_ms=18.019 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 423.428730] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:34.285Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"9eb25b80e2e35b77ce3f346f","created_at":"2026-09-08T06:01:30.958Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-da46eb43800644d0","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:30.962Z","job_size_bytes":23,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9eb25b80e2e35b77ce3f346f: done: 0.103103 sec","job_status":"done","queue_duration_s":3.219854,"scheduling_latency_s":3.219887,"gitaly_calls":1,"gitaly_duration_s":0.023042,"redis_calls":16,"redis_duration_s":0.008287000000000001,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000533,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.004008,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.103103,"completed_at":"2026-09-08T06:01:34.285Z","load_balancing_strategy":"primary","db_duration_s":0.006121,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1959gitlab # [ 423.476317] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:34.289Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3349bcb0b51a3a533f58bd77","created_at":"2026-09-08T06:01:31.823Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-da46eb43800644d0","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d37bd1b385cdfe4731c7aad9725b2cb49fce97b04e28c8d5569a10ef059445d1","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:31.834Z","job_size_bytes":467,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3349bcb0b51a3a533f58bd77: start","job_status":"start","queue_duration_s":2.454666,"scheduling_latency_s":2.454704}1960gitlab # [ 423.493458] gitaly[910]: time="2026-09-08T06:01:34.336Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:04.234" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:34.335" grpc.time_ms=0.944 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961gitlab # [ 423.505600] gitaly[910]: time="2026-09-08T06:01:34.356Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T06:01:44.099" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:34.339" grpc.time_ms=16.145 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 423.665447] gitaly[910]: time="2026-09-08T06:01:34.523Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T06:02:04.422" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:34.522" grpc.time_ms=0.658 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1963gitlab # [ 423.679506] gitaly[910]: time="2026-09-08T06:01:34.536Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=38 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-08T06:02:04.431" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:34.531" grpc.time_ms=4.162 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1964gitlab # [ 423.856051] gitaly[910]: time="2026-09-08T06:01:34.714Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:44.096" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:34.696" grpc.time_ms=17.427 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1965gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca'1966gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca', in 0.06 seconds)1967gitlab # [ 424.448340] nixbot[3554]: INFO: ::ffff:127.0.0.1:34240 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 200 OK1968gitlab # [ 424.483149] gitaly[910]: time="2026-09-08T06:01:35.341Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-08T06:02:05.213" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:35.313" grpc.time_ms=27.268 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969gitlab # [ 424.521768] gitaly[910]: time="2026-09-08T06:01:35.365Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSMCYSTDGAPJ1ZZD6QMSZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-08T06:02:05.244" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:35.344" grpc.time_ms=21.169 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970gitlab # [ 424.566283] sidekiq-cluster[3409]: {"severity":"WARN","time":"2026-09-08T06:01:35.423Z","class":"CreatePipelineWorker","correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"5009dc57e8e224fa1aafc1cbf6a041831968d342","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"5009dc57e8e224fa1aafc1cbf6a041831968d342","ref":"refs/heads/master"},"retry":0}1971gitlab # [ 424.586003] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:35.442Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3349bcb0b51a3a533f58bd77","created_at":"2026-09-08T06:01:31.823Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-da46eb43800644d0","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d37bd1b385cdfe4731c7aad9725b2cb49fce97b04e28c8d5569a10ef059445d1","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:31.834Z","job_size_bytes":467,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3349bcb0b51a3a533f58bd77: done: 1.15329 sec","job_status":"done","queue_duration_s":2.454666,"scheduling_latency_s":2.454704,"gitaly_calls":7,"gitaly_duration_s":0.110423,"redis_calls":51,"redis_duration_s":0.015082,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.00122,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005604,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002478,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004062,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001718,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.959146,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00096668,"duration_s":1.15329,"completed_at":"2026-09-08T06:01:35.442Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.084439,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1972gitlab # [ 424.664997] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:35.447Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"22607798-c2dd-46ac-b762-76028f637222\"}"],"class":"WebHookWorker","jid":"feebb96e89d96e6d64d51f32","created_at":"2026-09-08T06:01:32.086Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-da46eb43800644d0","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b030491b64572c46b567837e045d1281ebff4b728b7df4811cac621f72c064bd","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:32.094Z","job_size_bytes":1751,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-feebb96e89d96e6d64d51f32: start","job_status":"start","queue_duration_s":3.353683,"scheduling_latency_s":3.353742}1973gitlab # [ 424.827633] nixbot[3554]: INFO: ::ffff:127.0.0.1:34254 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1974gitlab # [ 424.868511] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:35.725Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"22607798-c2dd-46ac-b762-76028f637222\"}"],"class":"WebHookWorker","jid":"feebb96e89d96e6d64d51f32","created_at":"2026-09-08T06:01:32.086Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-da46eb43800644d0","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b030491b64572c46b567837e045d1281ebff4b728b7df4811cac621f72c064bd","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:32.094Z","job_size_bytes":1751,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-feebb96e89d96e6d64d51f32: done: 0.277606 sec","job_status":"done","queue_duration_s":3.353683,"scheduling_latency_s":3.353742,"redis_calls":19,"redis_duration_s":0.007921000000000001,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002154,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000725,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003133,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09185837999996238,"cpu_s":0.158963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006331,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.277606,"completed_at":"2026-09-08T06:01:35.725Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005792,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1975gitlab # [ 424.969435] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:35.728Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e9840b9b2d8e7cc04aee272a","created_at":"2026-09-08T06:01:32.818Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:32.824Z","job_size_bytes":23,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e9840b9b2d8e7cc04aee272a: start","job_status":"start","queue_duration_s":2.904305,"scheduling_latency_s":2.904343}1976gitlab # [ 425.004517] gitaly[910]: time="2026-09-08T06:01:35.862Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ37VFGQXZB7N4NG8MA1T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:35.842" grpc.time_ms=19.472 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1977gitlab # [ 425.025215] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1231978gitlab # [ 425.028396] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:35.885Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e9840b9b2d8e7cc04aee272a","created_at":"2026-09-08T06:01:32.818Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:32.824Z","job_size_bytes":23,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e9840b9b2d8e7cc04aee272a: done: 0.156803 sec","job_status":"done","queue_duration_s":2.904305,"scheduling_latency_s":2.904343,"redis_calls":10,"redis_duration_s":0.003463,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000708,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002031,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046432,"duration_s":0.156803,"completed_at":"2026-09-08T06:01:35.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028944,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1979gitlab # [ 425.090764] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:35.887Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b697469af6d00b1ba5eb986e","created_at":"2026-09-08T06:01:33.016Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.029Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b697469af6d00b1ba5eb986e: start","job_status":"start","queue_duration_s":2.858423,"scheduling_latency_s":2.858448}1980gitlab # [ 425.109980] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:35.950Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b697469af6d00b1ba5eb986e","created_at":"2026-09-08T06:01:33.016Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.029Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b697469af6d00b1ba5eb986e: done: 0.062835 sec","job_status":"done","queue_duration_s":2.858423,"scheduling_latency_s":2.858448,"redis_calls":10,"redis_duration_s":0.0034549999999999997,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000638,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002051,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00089316,"duration_s":0.062835,"completed_at":"2026-09-08T06:01:35.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1981gitlab # [ 425.154260] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:35.953Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"bc8a7bc1a464d855d118d9fe","created_at":"2026-09-08T06:01:33.057Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.072Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-bc8a7bc1a464d855d118d9fe: start","job_status":"start","queue_duration_s":2.881494,"scheduling_latency_s":2.881538}1982gitlab # [ 425.170591] gitaly[910]: time="2026-09-08T06:01:35.975Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ3BSC2YC9E5DAGCTENDJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:35.962" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1983gitlab # [ 425.180655] gitlab-workhorse[815]: time="2026-09-08T06:01:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671984gitlab # [ 425.182442] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1101985gitlab # [ 425.184308] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.030Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"bc8a7bc1a464d855d118d9fe","created_at":"2026-09-08T06:01:33.057Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.072Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-bc8a7bc1a464d855d118d9fe: done: 0.076579 sec","job_status":"done","queue_duration_s":2.881494,"scheduling_latency_s":2.881538,"redis_calls":10,"redis_duration_s":0.0049050000000000005,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001012,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002112,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001781,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005691,"duration_s":0.076579,"completed_at":"2026-09-08T06:01:36.030Z","load_balancing_strategy":"primary","db_duration_s":0.009971,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1986gitlab # [ 425.227209] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.035Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"16084f03e015dca3b948a981","created_at":"2026-09-08T06:01:33.103Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.116Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-16084f03e015dca3b948a981: start","job_status":"start","queue_duration_s":2.918559,"scheduling_latency_s":2.918592}1987gitlab # [ 425.243052] gitaly[910]: time="2026-09-08T06:01:35.975Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ3BSC2YC9E5DAGCTENDJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:35.962" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1988gitlab # [ 425.256520] gitlab-workhorse[815]: time="2026-09-08T06:01:36Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3381989gitlab # [ 425.258274] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:36 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 1061990gitlab # [ 425.260116] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.105Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"16084f03e015dca3b948a981","created_at":"2026-09-08T06:01:33.103Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.116Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-16084f03e015dca3b948a981: done: 0.070701 sec","job_status":"done","queue_duration_s":2.918559,"scheduling_latency_s":2.918592,"redis_calls":13,"redis_duration_s":0.006483,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003443,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001645,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062392,"duration_s":0.070701,"completed_at":"2026-09-08T06:01:36.105Z","load_balancing_strategy":"primary","db_duration_s":0.009997,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1991gitlab # [ 425.305231] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.107Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"66aa4ba6b9cd44317c902454","created_at":"2026-09-08T06:01:33.117Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.129Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-66aa4ba6b9cd44317c902454: start","job_status":"start","queue_duration_s":2.97815,"scheduling_latency_s":2.978269}1992gitlab # [ 425.321513] gitaly[910]: time="2026-09-08T06:01:35.976Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ3BSC2YC9E5DAGCTENDJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:35.962" grpc.time_ms=13.072 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1993gitlab # [ 425.335383] nixbot[3554]: {"ts": "2026-09-08T06:01:36.148Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1994gitlab # [ 425.337912] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.160Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"66aa4ba6b9cd44317c902454","created_at":"2026-09-08T06:01:33.117Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.129Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-66aa4ba6b9cd44317c902454: done: 0.052978 sec","job_status":"done","queue_duration_s":2.97815,"scheduling_latency_s":2.978269,"redis_calls":10,"redis_duration_s":0.003484,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00043,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070162,"duration_s":0.052978,"completed_at":"2026-09-08T06:01:36.160Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1995gitlab # [ 425.381462] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.163Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"31126bc9027e31810feccf80","created_at":"2026-09-08T06:01:33.131Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.144Z","job_size_bytes":19,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-31126bc9027e31810feccf80: start","job_status":"start","queue_duration_s":3.018567,"scheduling_latency_s":3.018606}1996gitlab # [ 425.397707] gitaly[910]: time="2026-09-08T06:01:36.084Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ3FBRJEDYASZXBZMN40Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:36.060" pid=910 remote_ip="2001:db8:1::1" request_sha=f6fe8b3635acb1e4e6eba3220bbaa3189a0b93f9 response_bytes=338 span.kind=server system=grpc1997gitlab # [ 425.407814] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.212Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"31126bc9027e31810feccf80","created_at":"2026-09-08T06:01:33.131Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.144Z","job_size_bytes":19,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-31126bc9027e31810feccf80: done: 0.049495 sec","job_status":"done","queue_duration_s":3.018567,"scheduling_latency_s":3.018606,"redis_calls":11,"redis_duration_s":0.004976,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002586,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001963,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000427,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034338,"duration_s":0.049495,"completed_at":"2026-09-08T06:01:36.212Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1998gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca'1999gitlab # [ 425.450979] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.214Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5e851097ab68b539074c0382","created_at":"2026-09-08T06:01:33.153Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.165Z","job_size_bytes":66,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5e851097ab68b539074c0382: start","job_status":"start","queue_duration_s":3.048911,"scheduling_latency_s":3.048935}2000gitlab # [ 425.466975] gitaly[910]: time="2026-09-08T06:01:36.085Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=4 command.system_time_ms=19 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ3FBRJEDYASZXBZMN40Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:36.060" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2001gitlab # [ 425.481288] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.265Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5e851097ab68b539074c0382","created_at":"2026-09-08T06:01:33.153Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.165Z","job_size_bytes":66,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5e851097ab68b539074c0382: done: 0.051588 sec","job_status":"done","queue_duration_s":3.048911,"scheduling_latency_s":3.048935,"redis_calls":10,"redis_duration_s":0.002333,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000729,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032374,"duration_s":0.051588,"completed_at":"2026-09-08T06:01:36.265Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2002gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca', in 0.08 seconds)2003gitlab # [ 425.525797] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.269Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"1c5358c91abbf3b5d79011ba","created_at":"2026-09-08T06:01:33.167Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.180Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1c5358c91abbf3b5d79011ba: start","job_status":"start","queue_duration_s":3.089565,"scheduling_latency_s":3.08961}2004gitlab # [ 425.542366] gitaly[910]: time="2026-09-08T06:01:36.085Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=4 command.system_time_ms=19 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ3FBRJEDYASZXBZMN40Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:36.060" grpc.time_ms=25.29 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2005gitlab # [ 425.557144] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2202006gitlab # [ 425.559598] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.358Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"1c5358c91abbf3b5d79011ba","created_at":"2026-09-08T06:01:33.167Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.180Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1c5358c91abbf3b5d79011ba: done: 0.08882 sec","job_status":"done","queue_duration_s":3.089565,"scheduling_latency_s":3.08961,"redis_calls":10,"redis_duration_s":0.008987,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000723,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004834,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00343,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055962,"duration_s":0.08882,"completed_at":"2026-09-08T06:01:36.358Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010664,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2007gitlab # [ 425.603020] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.361Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"58a149d3bb510721067d2a86","created_at":"2026-09-08T06:01:33.199Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.209Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-58a149d3bb510721067d2a86: start","job_status":"start","queue_duration_s":3.151735,"scheduling_latency_s":3.151759}2008gitlab # [ 425.619493] nixbot[3554]: INFO: ::ffff:127.0.0.1:34266 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 200 OK2009gitlab # [ 425.621482] nixbot[3554]: {"ts": "2026-09-08T06:01:36.390Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 \"HTTP/1.1 201 Created\""}2010gitlab # [ 425.624196] gitaly[910]: time="2026-09-08T06:01:36.255Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ3N8X34A5XJ2QK2HS58C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:06.253" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:36.254" grpc.time_ms=0.75 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab # [ 425.636400] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.409Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"58a149d3bb510721067d2a86","created_at":"2026-09-08T06:01:33.199Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.209Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-58a149d3bb510721067d2a86: done: 0.048109 sec","job_status":"done","queue_duration_s":3.151735,"scheduling_latency_s":3.151759,"redis_calls":10,"redis_duration_s":0.002541,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00108,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025242,"duration_s":0.048109,"completed_at":"2026-09-08T06:01:36.409Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2012gitlab # [ 425.680727] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.411Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"60611a3fecf5fc823e30c9f8","created_at":"2026-09-08T06:01:33.211Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.220Z","job_size_bytes":6,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-60611a3fecf5fc823e30c9f8: start","job_status":"start","queue_duration_s":3.191001,"scheduling_latency_s":3.191025}2013gitlab # [ 425.696846] gitaly[910]: time="2026-09-08T06:01:36.324Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ3N8X34A5XJ2QK2HS58C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:46.216" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:36.316" grpc.time_ms=7.825 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014gitlab # [ 425.710224] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.442Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"60611a3fecf5fc823e30c9f8","created_at":"2026-09-08T06:01:33.211Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.220Z","job_size_bytes":6,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-60611a3fecf5fc823e30c9f8: done: 0.030883 sec","job_status":"done","queue_duration_s":3.191001,"scheduling_latency_s":3.191025,"redis_calls":10,"redis_duration_s":0.001471,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033416,"duration_s":0.030883,"completed_at":"2026-09-08T06:01:36.442Z","load_balancing_strategy":"primary","db_duration_s":0.007025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2015gitlab # [ 425.753464] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.443Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1ccf4fa69cc857f89c71ef12","created_at":"2026-09-08T06:01:33.221Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.229Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1ccf4fa69cc857f89c71ef12: start","job_status":"start","queue_duration_s":3.213686,"scheduling_latency_s":3.213705}2016gitlab # [ 425.768654] gitaly[910]: time="2026-09-08T06:01:36.448Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ3WCBCQV3Z5T03AEJ743 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:06.447" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:36.447" grpc.time_ms=0.475 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2017gitlab # [ 425.781185] nixbot[3554]: {"ts": "2026-09-08T06:01:36.615Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 \"HTTP/1.1 201 Created\""}2018gitlab # [ 425.783833] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.617Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1ccf4fa69cc857f89c71ef12","created_at":"2026-09-08T06:01:33.221Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.229Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1ccf4fa69cc857f89c71ef12: done: 0.173604 sec","job_status":"done","queue_duration_s":3.213686,"scheduling_latency_s":3.213705,"redis_calls":10,"redis_duration_s":0.002128,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000461,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.158523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044414,"duration_s":0.173604,"completed_at":"2026-09-08T06:01:36.617Z","load_balancing_strategy":"primary","db_duration_s":0.006164,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2019gitlab # [ 425.827091] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.619Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"a771966e059f0f19d2462963","created_at":"2026-09-08T06:01:33.242Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.250Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-a771966e059f0f19d2462963: start","job_status":"start","queue_duration_s":3.369183,"scheduling_latency_s":3.369207}2020gitlab # [ 425.843688] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2162021gitlab # [ 425.846554] gitaly[910]: time="2026-09-08T06:01:36.522Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ3WCBCQV3Z5T03AEJ743 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:46.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:36.508" grpc.time_ms=13.76 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 425.860043] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.698Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"a771966e059f0f19d2462963","created_at":"2026-09-08T06:01:33.242Z","trace_propagation_headers":{"sentry-trace":"60389d191a5343468219bbeccea7585d-7f50202a402b417f","baggage":"sentry-trace_id=60389d191a5343468219bbeccea7585d,sentry-release=Unknown"},"correlation_id":"01M1ZSMJW1TPWP8R5RZ5MJGQSJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.250Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-a771966e059f0f19d2462963: done: 0.078833 sec","job_status":"done","queue_duration_s":3.369183,"scheduling_latency_s":3.369207,"redis_calls":14,"redis_duration_s":0.0073279999999999994,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000528,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004533,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002267,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00111752,"duration_s":0.078833,"completed_at":"2026-09-08T06:01:36.698Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2023gitlab # [ 425.905485] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.699Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"02752799ce6985ed239921e3","created_at":"2026-09-08T06:01:33.525Z","trace_propagation_headers":{"sentry-trace":"5eeb346bf5c64d88ab6ba8235be79097-135116b058604620","baggage":"sentry-trace_id=5eeb346bf5c64d88ab6ba8235be79097,sentry-release=Unknown"},"correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ea0257e08ad78c45df82ae2c","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.530Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-02752799ce6985ed239921e3: start","job_status":"start","queue_duration_s":3.169712,"scheduling_latency_s":3.169731}2024gitlab # [ 425.922436] gitaly[910]: time="2026-09-08T06:01:36.717Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ43GQ19D45K5TV1W2PQT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:06.715" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:36.716" grpc.time_ms=1.036 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025gitlab # [ 425.935103] gitaly[910]: time="2026-09-08T06:01:36.733Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M diskcache=20beffc4-42e6-49f7-b2e4-9a0b25f46f8c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T12:01:36.721" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:36.722" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026gitlab # [ 425.945053] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.761Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"02752799ce6985ed239921e3","created_at":"2026-09-08T06:01:33.525Z","trace_propagation_headers":{"sentry-trace":"5eeb346bf5c64d88ab6ba8235be79097-135116b058604620","baggage":"sentry-trace_id=5eeb346bf5c64d88ab6ba8235be79097,sentry-release=Unknown"},"correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ea0257e08ad78c45df82ae2c","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.530Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-02752799ce6985ed239921e3: done: 0.061426 sec","job_status":"done","queue_duration_s":3.169712,"scheduling_latency_s":3.169731,"gitaly_calls":1,"gitaly_duration_s":0.013585,"redis_calls":12,"redis_duration_s":0.004201,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002028,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000379,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001794,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.03557254,"duration_s":0.061426,"completed_at":"2026-09-08T06:01:36.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010792,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2027gitlab # [ 425.990597] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:36.763Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"05aaf156303e405aa49cec9e","created_at":"2026-09-08T06:01:33.755Z","trace_propagation_headers":{"sentry-trace":"5eeb346bf5c64d88ab6ba8235be79097-135116b058604620","baggage":"sentry-trace_id=5eeb346bf5c64d88ab6ba8235be79097,sentry-release=Unknown"},"correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f985a53c8493da571533ce84a12650b0a3ea21c513f87321e4ccc5cc10a67748","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.760Z","job_size_bytes":467,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-05aaf156303e405aa49cec9e: start","job_status":"start","queue_duration_s":3.003406,"scheduling_latency_s":3.003437}2028gitlab # [ 426.008208] gitaly[910]: time="2026-09-08T06:01:36.733Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T12:01:36.721" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:36.722" grpc.time_ms=11.21 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029gitlab # [ 426.022579] nixbot[3554]: {"ts": "2026-09-08T06:01:36.855Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 \"HTTP/1.1 201 Created\""}2030gitlab # [ 426.025877] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5009dc57e8e224fa1aafc1cbf6a041831968d342 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2292031gitlab # [ 426.028386] gitaly[910]: time="2026-09-08T06:01:36.771Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ43GQ19D45K5TV1W2PQT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:46.133" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:36.764" grpc.time_ms=7.526 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2032gitlab # [ 426.041672] gitaly[910]: time="2026-09-08T06:01:36.795Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:06.693" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:36.794" grpc.time_ms=1.084 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2033gitlab # [ 426.054071] gitaly[910]: time="2026-09-08T06:01:36.805Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T06:01:46.197" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:36.797" grpc.time_ms=7.5 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2034gitlab # [ 426.066967] gitaly[910]: time="2026-09-08T06:01:36.846Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T06:02:06.744" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:36.845" grpc.time_ms=0.795 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab # [ 426.079637] gitaly[910]: time="2026-09-08T06:01:36.853Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=33 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-08T06:02:06.750" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:36.850" grpc.time_ms=2.644 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2036gitlab # [ 426.097074] gitaly[910]: time="2026-09-08T06:01:36.902Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:46.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:36.893" grpc.time_ms=9.507 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2037gitlab # [ 426.110135] gitaly[910]: time="2026-09-08T06:01:36.967Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ4BRWWR87WVAK4GVG5Y8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:36.951" grpc.time_ms=16.382 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2038gitlab # [ 426.123107] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:36 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 792039gitlab # [ 426.192099] gitaly[910]: time="2026-09-08T06:01:37.050Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ4EAKECCWBMC4BFZWV1G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:37.032" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2040gitlab # [ 426.212109] gitaly[910]: time="2026-09-08T06:01:37.051Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ4EAKECCWBMC4BFZWV1G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:37.032" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2041gitlab # [ 426.232619] gitlab-workhorse[815]: time="2026-09-08T06:01:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672042gitlab # [ 426.235085] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 812043gitlab # [ 426.237695] gitaly[910]: time="2026-09-08T06:01:37.051Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ4EAKECCWBMC4BFZWV1G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:37.032" grpc.time_ms=19.355 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2044gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca'2045gitlab # [ 426.604302] nixbot[3554]: INFO: ::ffff:127.0.0.1:34278 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 200 OK2046gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca', in 0.08 seconds)2047gitlab # [ 426.611521] gitaly[910]: time="2026-09-08T06:01:37.466Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-08T06:02:07.049" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:37.450" grpc.time_ms=15.552 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048gitlab # [ 426.650341] gitaly[910]: time="2026-09-08T06:01:37.494Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSPV8XMCPH2PVHJCK9292M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-08T06:02:07.069" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:37.469" grpc.time_ms=24.371 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049gitlab # [ 426.673594] sidekiq-cluster[3409]: {"severity":"WARN","time":"2026-09-08T06:01:37.512Z","class":"CreatePipelineWorker","correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"5009dc57e8e224fa1aafc1cbf6a041831968d342","after":"4473f91e6d2f683dd5adcb9621434f2b014dabca","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4473f91e6d2f683dd5adcb9621434f2b014dabca","ref":"refs/heads/master"},"retry":0}2050gitlab # [ 426.683672] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:37.520Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"05aaf156303e405aa49cec9e","created_at":"2026-09-08T06:01:33.755Z","trace_propagation_headers":{"sentry-trace":"5eeb346bf5c64d88ab6ba8235be79097-135116b058604620","baggage":"sentry-trace_id=5eeb346bf5c64d88ab6ba8235be79097,sentry-release=Unknown"},"correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f985a53c8493da571533ce84a12650b0a3ea21c513f87321e4ccc5cc10a67748","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.760Z","job_size_bytes":467,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-05aaf156303e405aa49cec9e: done: 0.756614 sec","job_status":"done","queue_duration_s":3.003406,"scheduling_latency_s":3.003437,"gitaly_calls":7,"gitaly_duration_s":0.080822,"redis_calls":33,"redis_duration_s":0.005759,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.00059,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.0022,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001308,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.652192,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.756614,"completed_at":"2026-09-08T06:01:37.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025482,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2051gitlab # [ 426.747959] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:37.522Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"68d1dfdb-a3cd-4c19-bcc8-9a9fc8623371\"}"],"class":"WebHookWorker","jid":"d85b728239990ca57aa6c2ed","created_at":"2026-09-08T06:01:33.788Z","trace_propagation_headers":{"sentry-trace":"5eeb346bf5c64d88ab6ba8235be79097-135116b058604620","baggage":"sentry-trace_id=5eeb346bf5c64d88ab6ba8235be79097,sentry-release=Unknown"},"correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bb18ffe05622c0fbaa4169216dd5cf7e87ce2b066047b603fd58ea378e09706e","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.792Z","job_size_bytes":1749,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d85b728239990ca57aa6c2ed: start","job_status":"start","queue_duration_s":3.730451,"scheduling_latency_s":3.730486}2052gitlab # [ 426.769039] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:37.577Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"68d1dfdb-a3cd-4c19-bcc8-9a9fc8623371\"}"],"class":"WebHookWorker","jid":"d85b728239990ca57aa6c2ed","created_at":"2026-09-08T06:01:33.788Z","trace_propagation_headers":{"sentry-trace":"5eeb346bf5c64d88ab6ba8235be79097-135116b058604620","baggage":"sentry-trace_id=5eeb346bf5c64d88ab6ba8235be79097,sentry-release=Unknown"},"correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bb18ffe05622c0fbaa4169216dd5cf7e87ce2b066047b603fd58ea378e09706e","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:33.792Z","job_size_bytes":1749,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d85b728239990ca57aa6c2ed: done: 0.05469 sec","job_status":"done","queue_duration_s":3.730451,"scheduling_latency_s":3.730486,"redis_calls":14,"redis_duration_s":0.00386,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000481,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002184,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001195,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.008681440000032126,"cpu_s":0.03466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.05469,"completed_at":"2026-09-08T06:01:37.577Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2053gitlab # [ 426.819238] nixbot[3554]: INFO: ::ffff:127.0.0.1:34288 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2054gitlab # [ 426.820549] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:37.579Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"0add473302583ce2425de7b6","created_at":"2026-09-08T06:01:33.989Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-2e40a8b00e1f4ae8","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:34.000Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-0add473302583ce2425de7b6: start","job_status":"start","queue_duration_s":3.578857,"scheduling_latency_s":3.578882}2055gitlab # [ 426.836347] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:37.641Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"0add473302583ce2425de7b6","created_at":"2026-09-08T06:01:33.989Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-2e40a8b00e1f4ae8","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:34.000Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-0add473302583ce2425de7b6: done: 0.062522 sec","job_status":"done","queue_duration_s":3.578857,"scheduling_latency_s":3.578882,"redis_calls":19,"redis_duration_s":0.005245,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001331,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000745,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002281,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01018106,"duration_s":0.062522,"completed_at":"2026-09-08T06:01:37.641Z","load_balancing_strategy":"primary","db_duration_s":0.011235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2056gitlab # [ 426.881271] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:37 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1092057gitlab # [ 426.883330] gitaly[910]: time="2026-09-08T06:01:37.716Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ527E0X9T27YFH2PHVBF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:37.700" grpc.time_ms=15.425 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2058gitlab # [ 426.896619] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:37.643Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","feebb96e89d96e6d64d51f32"],"class":"WebHooks::LogExecutionWorker","jid":"930d66260f1cc208b5524717","created_at":"2026-09-08T06:01:35.691Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-7fd9dc94419743cb","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a19655fc77e3f061a23ad56c73635fe93fa4f39fbddd61b724b73ecaba1bae5e","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:35.704Z","job_size_bytes":2593,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-930d66260f1cc208b5524717: start","job_status":"start","queue_duration_s":1.939126,"scheduling_latency_s":1.939149}2059gitlab # [ 426.914224] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:37.694Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","feebb96e89d96e6d64d51f32"],"class":"WebHooks::LogExecutionWorker","jid":"930d66260f1cc208b5524717","created_at":"2026-09-08T06:01:35.691Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-7fd9dc94419743cb","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a19655fc77e3f061a23ad56c73635fe93fa4f39fbddd61b724b73ecaba1bae5e","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:35.704Z","job_size_bytes":2593,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-930d66260f1cc208b5524717: done: 0.050769 sec","job_status":"done","queue_duration_s":1.939126,"scheduling_latency_s":1.939149,"redis_calls":10,"redis_duration_s":0.003004,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033476,"duration_s":0.050769,"completed_at":"2026-09-08T06:01:37.694Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2060gitlab # [ 426.958544] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:37.696Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"15d418e700ee9f94f1289f93","created_at":"2026-09-08T06:01:36.369Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-96099e850cda4f3b","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:36.373Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-15d418e700ee9f94f1289f93: start","job_status":"start","queue_duration_s":1.322825,"scheduling_latency_s":1.322843}2061gitlab # [ 426.974538] gitaly[910]: time="2026-09-08T06:01:37.819Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ55R575YC1CZ31K7SK5Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:37.797" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2062gitlab # [ 426.984814] gitlab-workhorse[815]: time="2026-09-08T06:01:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672063gitlab # [ 426.986605] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1012064gitlab # [ 426.988517] gitaly[910]: time="2026-09-08T06:01:37.819Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ55R575YC1CZ31K7SK5Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:37.797" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2065gitlab # [ 427.001665] gitaly[910]: time="2026-09-08T06:01:37.820Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ55R575YC1CZ31K7SK5Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:37.797" grpc.time_ms=22.639 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2066gitlab # [ 427.015964] gitaly[910]: time="2026-09-08T06:01:37.835Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ3N8X34A5XJ2QK2HS58C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:37.834" grpc.time_ms=0.439 pid=910 span.kind=server system=grpc2067gitlab # [ 427.025834] gitaly[910]: time="2026-09-08T06:01:37.883Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ3N8X34A5XJ2QK2HS58C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:37.882" grpc.time_ms=0.491 pid=910 span.kind=server system=grpc2068gitlab # [ 427.057168] gitaly[910]: time="2026-09-08T06:01:37.915Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ3N8X34A5XJ2QK2HS58C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:37.914" grpc.time_ms=0.399 pid=910 span.kind=server system=grpc2069gitlab # [ 427.069162] gitaly[910]: time="2026-09-08T06:01:37.927Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ3N8X34A5XJ2QK2HS58C diskcache=a7ebc304-ba8d-45a6-8488-180ea54f0ea9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T06:02:07.399" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:37.801" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2070gitlab # [ 427.079461] gitaly[910]: time="2026-09-08T06:01:37.927Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=115 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7003 command.oublock=0 command.real_time_ms=118 command.spawn_token_fork_ms=1 command.system_time_ms=67 command.user_time_ms=48 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ3N8X34A5XJ2QK2HS58C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T06:02:07.399" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:37.801" grpc.time_ms=126.271 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 427.093699] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:37 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 712072gitlab # [ 427.095740] gitaly[910]: time="2026-09-08T06:01:37.936Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ5A92XFBV1QDD9XHYPG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:37.925" grpc.time_ms=10.742 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2073gitlab # [ 427.136550] gitaly[910]: time="2026-09-08T06:01:37.994Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ3N8X34A5XJ2QK2HS58C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T06:02:07.592" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:37.993" grpc.time_ms=1.349 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab # [ 427.179967] gitaly[910]: time="2026-09-08T06:01:38.038Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ3N8X34A5XJ2QK2HS58C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:08.036" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:38.036" grpc.time_ms=1.126 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2075gitlab # [ 427.200388] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.052Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"15d418e700ee9f94f1289f93","created_at":"2026-09-08T06:01:36.369Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-96099e850cda4f3b","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:36.373Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3409,"job_status":"rescheduled","message":"PipelineProcessWorker JID-15d418e700ee9f94f1289f93: rescheduled"}2076gitlab # [ 427.220938] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.060Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"15d418e700ee9f94f1289f93","created_at":"2026-09-08T06:01:36.369Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-96099e850cda4f3b","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:36.373Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-15d418e700ee9f94f1289f93: done: 0.364934 sec","job_status":"done","queue_duration_s":1.322825,"scheduling_latency_s":1.322843,"gitaly_calls":3,"gitaly_duration_s":0.138819,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.017218,"redis_read_bytes":148,"redis_write_bytes":18009,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.00068,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00102,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003095,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12308,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005663,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000481,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000597,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.005002,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":31,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":31,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.160699,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.3192595,"duration_s":0.364934,"completed_at":"2026-09-08T06:01:38.060Z","load_balancing_strategy":"primary","db_duration_s":0.059303,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2077gitlab # [ 427.275786] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.063Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d85b728239990ca57aa6c2ed"],"class":"WebHooks::LogExecutionWorker","jid":"55f0327a55ba05ec989f1adc","created_at":"2026-09-08T06:01:37.564Z","trace_propagation_headers":{"sentry-trace":"5eeb346bf5c64d88ab6ba8235be79097-c9bb2d4359a34a07","baggage":"sentry-trace_id=5eeb346bf5c64d88ab6ba8235be79097,sentry-release=Unknown"},"correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ff79084f3c0f6aff8d246f0454ac4a7067f2dffe0ebc79fb245ac1941d128c59","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.568Z","job_size_bytes":2592,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-55f0327a55ba05ec989f1adc: start","job_status":"start","queue_duration_s":0.494005,"scheduling_latency_s":0.494032}2078gitlab # [ 427.292713] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.093Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d85b728239990ca57aa6c2ed"],"class":"WebHooks::LogExecutionWorker","jid":"55f0327a55ba05ec989f1adc","created_at":"2026-09-08T06:01:37.564Z","trace_propagation_headers":{"sentry-trace":"5eeb346bf5c64d88ab6ba8235be79097-c9bb2d4359a34a07","baggage":"sentry-trace_id=5eeb346bf5c64d88ab6ba8235be79097,sentry-release=Unknown"},"correlation_id":"01M1ZSPV8XMCPH2PVHJCK9292M","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ff79084f3c0f6aff8d246f0454ac4a7067f2dffe0ebc79fb245ac1941d128c59","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.568Z","job_size_bytes":2592,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-55f0327a55ba05ec989f1adc: done: 0.030821 sec","job_status":"done","queue_duration_s":0.494005,"scheduling_latency_s":0.494032,"redis_calls":7,"redis_duration_s":0.001975,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001442,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030821,"completed_at":"2026-09-08T06:01:38.093Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0053,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079gitlab # [ 427.335520] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.095Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"9319a82e726be8957b660a3f","created_at":"2026-09-08T06:01:37.624Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-14ef6310dbc24fa7","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.631Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-9319a82e726be8957b660a3f: start","job_status":"start","queue_duration_s":0.464057,"scheduling_latency_s":0.46408}2080gitlab # [ 427.354239] gitaly[910]: time="2026-09-08T06:01:38.202Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ5CNT7CPTGXDMXDN6PN7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:38.183" pid=910 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2081gitlab # [ 427.364961] gitlab-workhorse[815]: time="2026-09-08T06:01:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162082gitlab # [ 427.366777] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 2612083gitlab # [ 427.368718] gitaly[910]: time="2026-09-08T06:01:38.202Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ5CNT7CPTGXDMXDN6PN7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:38.183" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2084gitlab # [ 427.382388] gitaly[910]: time="2026-09-08T06:01:38.202Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ5CNT7CPTGXDMXDN6PN7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:38.183" grpc.time_ms=19.834 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2085gitlab # [ 427.396990] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.234Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"9319a82e726be8957b660a3f","created_at":"2026-09-08T06:01:37.624Z","trace_propagation_headers":{"sentry-trace":"1915b773e2d04d0aa6e5d1e82b02f1a6-14ef6310dbc24fa7","baggage":"sentry-trace_id=1915b773e2d04d0aa6e5d1e82b02f1a6,sentry-release=Unknown"},"correlation_id":"01M1ZSMCYSTDGAPJ1ZZD6QMSZ1","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.631Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-9319a82e726be8957b660a3f: done: 0.139222 sec","job_status":"done","queue_duration_s":0.464057,"scheduling_latency_s":0.46408,"redis_calls":11,"redis_duration_s":0.006514,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000564,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003987,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001963,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00077692,"duration_s":0.139222,"completed_at":"2026-09-08T06:01:38.234Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2086gitlab # [ 427.442162] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.238Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e538127029b88d8d7da1fe39","created_at":"2026-09-08T06:01:37.791Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.793Z","job_size_bytes":23,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e538127029b88d8d7da1fe39: start","job_status":"start","queue_duration_s":0.444171,"scheduling_latency_s":0.444213}2087gitlab # [ 427.458547] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.302Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e538127029b88d8d7da1fe39","created_at":"2026-09-08T06:01:37.791Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.793Z","job_size_bytes":23,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e538127029b88d8d7da1fe39: done: 0.064762 sec","job_status":"done","queue_duration_s":0.444171,"scheduling_latency_s":0.444213,"redis_calls":7,"redis_duration_s":0.0017759999999999998,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001287,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064762,"completed_at":"2026-09-08T06:01:38.302Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01071,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2088gitlab # [ 427.501148] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.304Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a475fdb9873e619fb3a95816","created_at":"2026-09-08T06:01:37.933Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.936Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a475fdb9873e619fb3a95816: start","job_status":"start","queue_duration_s":0.367543,"scheduling_latency_s":0.367569}2089gitlab # [ 427.517784] gitaly[910]: time="2026-09-08T06:01:38.307Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:08.206" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:38.306" grpc.time_ms=0.647 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 427.530390] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.342Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a475fdb9873e619fb3a95816","created_at":"2026-09-08T06:01:37.933Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.936Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a475fdb9873e619fb3a95816: done: 0.038309 sec","job_status":"done","queue_duration_s":0.367543,"scheduling_latency_s":0.367569,"redis_calls":7,"redis_duration_s":0.0030499999999999998,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002512,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000538,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038309,"completed_at":"2026-09-08T06:01:38.342Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2091gitlab # [ 427.574331] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.344Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cf84ba718cfb58de24f211a6","created_at":"2026-09-08T06:01:37.949Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.952Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cf84ba718cfb58de24f211a6: start","job_status":"start","queue_duration_s":0.391869,"scheduling_latency_s":0.391894}2092gitlab # [ 427.590201] gitaly[910]: time="2026-09-08T06:01:38.329Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-08T06:02:08.218" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:38.319" grpc.time_ms=10.563 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca'2094gitlab # [ 427.603992] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.399Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cf84ba718cfb58de24f211a6","created_at":"2026-09-08T06:01:37.949Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.952Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cf84ba718cfb58de24f211a6: done: 0.05471 sec","job_status":"done","queue_duration_s":0.391869,"scheduling_latency_s":0.391894,"redis_calls":7,"redis_duration_s":0.002008,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05471,"completed_at":"2026-09-08T06:01:38.399Z","load_balancing_strategy":"primary","db_duration_s":0.007371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2095gitlab # [ 427.643424] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.401Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4d1b9f882bc89b3e1b0f1c61","created_at":"2026-09-08T06:01:37.962Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.965Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4d1b9f882bc89b3e1b0f1c61: start","job_status":"start","queue_duration_s":0.436525,"scheduling_latency_s":0.436557}2096gitlab # [ 427.659835] gitaly[910]: time="2026-09-08T06:01:38.351Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:48.292" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:38.342" grpc.time_ms=8.859 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca', in 0.09 seconds)2098(finished: subtest: push delivers the webhook, in 86.75 seconds)2099subtest: eval and build post commit statuses2100gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses2101gitlab # [ 427.673642] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.444Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4d1b9f882bc89b3e1b0f1c61","created_at":"2026-09-08T06:01:37.962Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.965Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4d1b9f882bc89b3e1b0f1c61: done: 0.043171 sec","job_status":"done","queue_duration_s":0.436525,"scheduling_latency_s":0.436557,"redis_calls":10,"redis_duration_s":0.001938,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000507,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043171,"completed_at":"2026-09-08T06:01:38.444Z","load_balancing_strategy":"primary","db_duration_s":0.007592,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2102gitlab # [ 427.717484] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.446Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"784ecf0444282dc5e3aab8eb","created_at":"2026-09-08T06:01:37.965Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.967Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-784ecf0444282dc5e3aab8eb: start","job_status":"start","queue_duration_s":0.478827,"scheduling_latency_s":0.478856}2103gitlab # [ 427.733931] gitaly[910]: time="2026-09-08T06:01:38.390Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T06:01:48.009" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:01:38.389" grpc.time_ms=0.331 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab # [ 427.744634] nixbot[3554]: INFO: ::ffff:127.0.0.1:34292 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 200 OK2105gitlab # [ 427.746553] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.476Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"784ecf0444282dc5e3aab8eb","created_at":"2026-09-08T06:01:37.965Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.967Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-784ecf0444282dc5e3aab8eb: done: 0.030096 sec","job_status":"done","queue_duration_s":0.478827,"scheduling_latency_s":0.478856,"redis_calls":7,"redis_duration_s":0.0010869999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000298,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030096,"completed_at":"2026-09-08T06:01:38.476Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2106gitlab # [ 427.789862] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.477Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1b64ec3953c3b974f211cda5","created_at":"2026-09-08T06:01:37.968Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.970Z","job_size_bytes":19,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1b64ec3953c3b974f211cda5: start","job_status":"start","queue_duration_s":0.506858,"scheduling_latency_s":0.506878}2107gitlab # [ 427.805817] gitaly[910]: time="2026-09-08T06:01:38.406Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T06:01:48.017" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:38.397" grpc.time_ms=8.299 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 427.819047] gitaly[910]: time="2026-09-08T06:01:38.451Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:38.450" grpc.time_ms=0.758 pid=910 span.kind=server system=grpc2109gitlab # [ 427.828764] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.503Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1b64ec3953c3b974f211cda5","created_at":"2026-09-08T06:01:37.968Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.970Z","job_size_bytes":19,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1b64ec3953c3b974f211cda5: done: 0.02558 sec","job_status":"done","queue_duration_s":0.506858,"scheduling_latency_s":0.506878,"redis_calls":8,"redis_duration_s":0.001377,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000386,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02558,"completed_at":"2026-09-08T06:01:38.503Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004217,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2110gitlab # [ 427.871002] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.504Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2b199900b552a4af55d522c3","created_at":"2026-09-08T06:01:37.972Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.974Z","job_size_bytes":66,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2b199900b552a4af55d522c3: start","job_status":"start","queue_duration_s":0.530488,"scheduling_latency_s":0.530507}2111gitlab # [ 427.888269] gitaly[910]: time="2026-09-08T06:01:38.479Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:38.479" grpc.time_ms=0.372 pid=910 span.kind=server system=grpc2112gitlab # [ 427.897847] gitaly[910]: time="2026-09-08T06:01:38.487Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ diskcache=02b5b28a-72ae-4594-bb14-89f3210aaba2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T06:01:48.028" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:01:38.408" pid=910 ref=refs/keep-around/4473f91e6d2f683dd5adcb9621434f2b014dabca remote_ip="2001:db8:1::1" revision=4473f91e6d2f683dd5adcb9621434f2b014dabca span.kind=server system=grpc username=root2113gitlab # [ 427.909669] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.538Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2b199900b552a4af55d522c3","created_at":"2026-09-08T06:01:37.972Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.974Z","job_size_bytes":66,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2b199900b552a4af55d522c3: done: 0.033509 sec","job_status":"done","queue_duration_s":0.530488,"scheduling_latency_s":0.530507,"redis_calls":7,"redis_duration_s":0.001908,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033509,"completed_at":"2026-09-08T06:01:38.538Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2114gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses, in 0.27 seconds)2115gitlab # [ 427.954576] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.539Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f2148dd079aa2ea62e6c9835","created_at":"2026-09-08T06:01:37.974Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.976Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f2148dd079aa2ea62e6c9835: start","job_status":"start","queue_duration_s":0.562851,"scheduling_latency_s":0.562872}2116gitlab # [ 427.970803] nixbot[3554]: {"ts": "2026-09-08T06:01:38.755Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4473f91e6d2f683dd5adcb9621434f2b014dabca \"HTTP/1.1 201 Created\""}2117gitlab # [ 427.973702] nixbot[3554]: {"ts": "2026-09-08T06:01:38.771Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-4473f91e6d2f-5"}2118gitlab # [ 427.975977] gitaly[910]: time="2026-09-08T06:01:38.487Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=74 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5297 command.oublock=8 command.real_time_ms=73 command.spawn_token_fork_ms=0 command.system_time_ms=40 command.user_time_ms=34 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T06:01:48.028" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T06:01:38.408" grpc.time_ms=78.885 pid=910 ref=refs/keep-around/4473f91e6d2f683dd5adcb9621434f2b014dabca remote_ip="2001:db8:1::1" revision=4473f91e6d2f683dd5adcb9621434f2b014dabca span.kind=server system=grpc username=root2119gitlab # [ 427.992168] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5182120gitlab # [ 427.994626] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1942121gitlab # [ 427.997406] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.569Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f2148dd079aa2ea62e6c9835","created_at":"2026-09-08T06:01:37.974Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.976Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f2148dd079aa2ea62e6c9835: done: 0.029708 sec","job_status":"done","queue_duration_s":0.562851,"scheduling_latency_s":0.562872,"redis_calls":7,"redis_duration_s":0.001359,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029708,"completed_at":"2026-09-08T06:01:38.569Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006135,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2122gitlab # [ 428.039817] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.570Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e2ea5a353474702377be2805","created_at":"2026-09-08T06:01:37.977Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.979Z","job_size_bytes":6,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e2ea5a353474702377be2805: start","job_status":"start","queue_duration_s":0.591753,"scheduling_latency_s":0.591775}2123gitlab # [ 428.055590] gitaly[910]: time="2026-09-08T06:01:38.491Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:08.390" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:38.491" grpc.time_ms=0.497 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 428.068337] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.596Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e2ea5a353474702377be2805","created_at":"2026-09-08T06:01:37.977Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.979Z","job_size_bytes":6,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e2ea5a353474702377be2805: done: 0.025952 sec","job_status":"done","queue_duration_s":0.591753,"scheduling_latency_s":0.591775,"redis_calls":7,"redis_duration_s":0.003505,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000378,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025952,"completed_at":"2026-09-08T06:01:38.596Z","load_balancing_strategy":"primary","db_duration_s":0.005056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2125gitlab # [ 428.109671] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.598Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6b12d0c7f2056ac04da0bdfb","created_at":"2026-09-08T06:01:37.979Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.981Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6b12d0c7f2056ac04da0bdfb: start","job_status":"start","queue_duration_s":0.616771,"scheduling_latency_s":0.616791}2126gitlab # [ 428.124984] gitaly[910]: time="2026-09-08T06:01:38.753Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ613VA4TKCBY3JNHH6Y0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:08.650" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:38.751" grpc.time_ms=1.652 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 428.137611] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.626Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6b12d0c7f2056ac04da0bdfb","created_at":"2026-09-08T06:01:37.979Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:37.981Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6b12d0c7f2056ac04da0bdfb: done: 0.028083 sec","job_status":"done","queue_duration_s":0.616771,"scheduling_latency_s":0.616791,"redis_calls":7,"redis_duration_s":0.001044,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028083,"completed_at":"2026-09-08T06:01:38.626Z","load_balancing_strategy":"primary","db_duration_s":0.005962,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2128gitlab # [ 428.178401] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.627Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"24cbedb0b7e091f1b29f0a1a","created_at":"2026-09-08T06:01:38.052Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:38.055Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-24cbedb0b7e091f1b29f0a1a: start","job_status":"start","queue_duration_s":0.572575,"scheduling_latency_s":0.572597}2129gitlab # [ 428.193895] gitaly[910]: time="2026-09-08T06:01:38.884Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T06:02:08.481" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:38.882" grpc.time_ms=1.659 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 428.207485] nixbot[3554]: {"ts": "2026-09-08T06:01:38.998Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4473f91e6d2f-5", "argv0": "bwrap"}2131gitlab # [ 428.209991] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.667Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"24cbedb0b7e091f1b29f0a1a","created_at":"2026-09-08T06:01:38.052Z","trace_propagation_headers":{"sentry-trace":"cfd4ab83728f4a7f9630317f4ef80f84-b356add87b61413d","baggage":"sentry-trace_id=cfd4ab83728f4a7f9630317f4ef80f84,sentry-release=Unknown"},"correlation_id":"01M1ZSQ3N8X34A5XJ2QK2HS58C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:38.055Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-24cbedb0b7e091f1b29f0a1a: done: 0.039529 sec","job_status":"done","queue_duration_s":0.572575,"scheduling_latency_s":0.572597,"redis_calls":8,"redis_duration_s":0.003265,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00223,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039529,"completed_at":"2026-09-08T06:01:38.667Z","load_balancing_strategy":"primary","db_duration_s":0.011725,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2132gitlab # [ 428.250820] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.668Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a140aca7aa4c4e864fdbfa70","created_at":"2026-09-08T06:01:38.497Z","trace_propagation_headers":{"sentry-trace":"bdb1e09901d540f897bbebb2d53cbaaf-ebfb9e8aa8974abc","baggage":"sentry-trace_id=bdb1e09901d540f897bbebb2d53cbaaf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQ5NVRK4AMGFTJWD684PQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:38.502Z","job_size_bytes":65,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a140aca7aa4c4e864fdbfa70: start","job_status":"start","queue_duration_s":0.166235,"scheduling_latency_s":0.166257}2133gitlab # [ 428.267162] gitaly[910]: time="2026-09-08T06:01:38.919Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ5NVRK4AMGFTJWD684PQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:08.518" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:38.918" grpc.time_ms=0.84 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 428.279407] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.714Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a140aca7aa4c4e864fdbfa70","created_at":"2026-09-08T06:01:38.497Z","trace_propagation_headers":{"sentry-trace":"bdb1e09901d540f897bbebb2d53cbaaf-ebfb9e8aa8974abc","baggage":"sentry-trace_id=bdb1e09901d540f897bbebb2d53cbaaf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQ5NVRK4AMGFTJWD684PQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:38.502Z","job_size_bytes":65,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a140aca7aa4c4e864fdbfa70: done: 0.045734 sec","job_status":"done","queue_duration_s":0.166235,"scheduling_latency_s":0.166257,"redis_calls":7,"redis_duration_s":0.0027210000000000003,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002393,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000328,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045734,"completed_at":"2026-09-08T06:01:38.714Z","load_balancing_strategy":"primary","db_duration_s":0.010874,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2135gitlab # [ 428.321987] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.715Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"dba0a9cdeea9936a293c2ba0","created_at":"2026-09-08T06:01:38.503Z","trace_propagation_headers":{"sentry-trace":"bdb1e09901d540f897bbebb2d53cbaaf-ebfb9e8aa8974abc","baggage":"sentry-trace_id=bdb1e09901d540f897bbebb2d53cbaaf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQ5NVRK4AMGFTJWD684PQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:38.506Z","job_size_bytes":65,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-dba0a9cdeea9936a293c2ba0: start","job_status":"start","queue_duration_s":0.209398,"scheduling_latency_s":0.209424}2136gitlab # [ 428.339348] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.796Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"dba0a9cdeea9936a293c2ba0","created_at":"2026-09-08T06:01:38.503Z","trace_propagation_headers":{"sentry-trace":"bdb1e09901d540f897bbebb2d53cbaaf-ebfb9e8aa8974abc","baggage":"sentry-trace_id=bdb1e09901d540f897bbebb2d53cbaaf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQ5NVRK4AMGFTJWD684PQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:38.506Z","job_size_bytes":65,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-dba0a9cdeea9936a293c2ba0: done: 0.080848 sec","job_status":"done","queue_duration_s":0.209398,"scheduling_latency_s":0.209424,"redis_calls":10,"redis_duration_s":0.0034760000000000004,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002622,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.080848,"completed_at":"2026-09-08T06:01:38.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2137gitlab # [ 428.382981] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.799Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"cb733b0b366a0ccd9d3526e8","created_at":"2026-09-08T06:01:38.670Z","trace_propagation_headers":{"sentry-trace":"bdb1e09901d540f897bbebb2d53cbaaf-ebfb9e8aa8974abc","baggage":"sentry-trace_id=bdb1e09901d540f897bbebb2d53cbaaf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQ5NVRK4AMGFTJWD684PQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:38.685Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cb733b0b366a0ccd9d3526e8: start","job_status":"start","queue_duration_s":0.11442,"scheduling_latency_s":0.114451}2138gitlab # [ 428.398742] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.939Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"cb733b0b366a0ccd9d3526e8","created_at":"2026-09-08T06:01:38.670Z","trace_propagation_headers":{"sentry-trace":"bdb1e09901d540f897bbebb2d53cbaaf-ebfb9e8aa8974abc","baggage":"sentry-trace_id=bdb1e09901d540f897bbebb2d53cbaaf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQ5NVRK4AMGFTJWD684PQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:38.685Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cb733b0b366a0ccd9d3526e8: done: 0.139983 sec","job_status":"done","queue_duration_s":0.11442,"scheduling_latency_s":0.114451,"gitaly_calls":2,"gitaly_duration_s":0.008549,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.005815,"redis_read_bytes":79,"redis_write_bytes":5120,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000689,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000971,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000198,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1131,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00172,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000179,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000428,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106127,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09493506,"duration_s":0.139983,"completed_at":"2026-09-08T06:01:38.939Z","load_balancing_strategy":"primary","db_duration_s":0.023938,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2139gitlab # [ 428.450471] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.941Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"33cf85dba7b40c8160d3dfc5","created_at":"2026-09-08T06:01:38.865Z","trace_propagation_headers":{"sentry-trace":"bdb1e09901d540f897bbebb2d53cbaaf-4ec36157a2344b17","baggage":"sentry-trace_id=bdb1e09901d540f897bbebb2d53cbaaf,sentry-release=Unknown"},"correlation_id":"01M1ZSQ5NVRK4AMGFTJWD684PQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:38.867Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-33cf85dba7b40c8160d3dfc5: start","job_status":"start","queue_duration_s":0.074553,"scheduling_latency_s":0.074595}2140gitlab # [ 428.466432] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:38.989Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"33cf85dba7b40c8160d3dfc5","created_at":"2026-09-08T06:01:38.865Z","trace_propagation_headers":{"sentry-trace":"bdb1e09901d540f897bbebb2d53cbaaf-4ec36157a2344b17","baggage":"sentry-trace_id=bdb1e09901d540f897bbebb2d53cbaaf,sentry-release=Unknown"},"correlation_id":"01M1ZSQ5NVRK4AMGFTJWD684PQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:38.867Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-33cf85dba7b40c8160d3dfc5: done: 0.048043 sec","job_status":"done","queue_duration_s":0.074553,"scheduling_latency_s":0.074595,"redis_calls":7,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048043,"completed_at":"2026-09-08T06:01:38.989Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00537,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2141gitlab # [ 428.509828] nix-daemon[3721]: accepted connection from pid 4746, user nixbot2142gitlab # [ 428.746977] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:39.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"afba5cb9113dea41e753342c","created_at":"2026-09-08T06:01:39.579Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d15353ce63f53eb39c57ed39e3648a8c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.599Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-afba5cb9113dea41e753342c: start","job_status":"start","queue_duration_s":0.003237,"scheduling_latency_s":0.003294}2143gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses2144gitlab # [ 428.891193] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:39.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"afba5cb9113dea41e753342c","created_at":"2026-09-08T06:01:39.579Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d15353ce63f53eb39c57ed39e3648a8c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.599Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-afba5cb9113dea41e753342c: done: 0.145066 sec","job_status":"done","queue_duration_s":0.003237,"scheduling_latency_s":0.003294,"redis_calls":12,"redis_duration_s":0.030270000000000002,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015838,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00917,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02068646,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.145066,"completed_at":"2026-09-08T06:01:39.748Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010797,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2145gitlab # [ 428.983244] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:39.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a3ca47c09de282128255f152","created_at":"2026-09-08T06:01:39.618Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"796effabf0216ae0b18bc42daf04a0ab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.632Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a3ca47c09de282128255f152: start","job_status":"start","queue_duration_s":0.121132,"scheduling_latency_s":0.121184}2146gitlab # [ 429.151160] gitaly[910]: time="2026-09-08T06:01:40.008Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ79XNJW9G947AX0T044Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:10.005" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:40.006" grpc.time_ms=1.189 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses, in 0.24 seconds)2148gitlab # [ 429.200523] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1552149gitlab # [ 429.218346] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.075Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a3ca47c09de282128255f152","created_at":"2026-09-08T06:01:39.618Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"796effabf0216ae0b18bc42daf04a0ab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.632Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a3ca47c09de282128255f152: done: 0.321776 sec","job_status":"done","queue_duration_s":0.121132,"scheduling_latency_s":0.121184,"redis_calls":13,"redis_duration_s":0.040728,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.017007,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017475,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.097,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.092,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00354498,"exclusive_lock_hold_duration_s":0.20423084,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.321776,"completed_at":"2026-09-08T06:01:40.075Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.112501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2150gitlab # [ 429.303272] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.087Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d5e878e3f6e2311ee1a03ed8","created_at":"2026-09-08T06:01:39.659Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1885dccd64e28a510cbf2f6b8a1a2306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.683Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d5e878e3f6e2311ee1a03ed8: start","job_status":"start","queue_duration_s":0.403372,"scheduling_latency_s":0.403425}2151gitlab # [ 429.370630] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d5e878e3f6e2311ee1a03ed8","created_at":"2026-09-08T06:01:39.659Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1885dccd64e28a510cbf2f6b8a1a2306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.683Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d5e878e3f6e2311ee1a03ed8: done: 0.140636 sec","job_status":"done","queue_duration_s":0.403372,"scheduling_latency_s":0.403425,"redis_calls":11,"redis_duration_s":0.024793000000000003,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002099,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012623,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010071,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00206074,"exclusive_lock_hold_duration_s":0.01921834,"duration_s":0.140636,"completed_at":"2026-09-08T06:01:40.227Z","load_balancing_strategy":"primary","db_duration_s":0.011449,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2152gitlab # [ 429.469849] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3d9b8f052ed1448602e30df7","created_at":"2026-09-08T06:01:39.713Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5013a6ac4dce791133f06c6351de256","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.776Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3d9b8f052ed1448602e30df7: start","job_status":"start","queue_duration_s":0.46365,"scheduling_latency_s":0.463699}2153gitlab # [ 429.704049] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3d9b8f052ed1448602e30df7","created_at":"2026-09-08T06:01:39.713Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5013a6ac4dce791133f06c6351de256","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.776Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3d9b8f052ed1448602e30df7: done: 0.320867 sec","job_status":"done","queue_duration_s":0.46365,"scheduling_latency_s":0.463699,"redis_calls":9,"redis_duration_s":0.010291,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002577,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003019,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.320867,"completed_at":"2026-09-08T06:01:40.560Z","load_balancing_strategy":"primary","db_duration_s":0.038553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2154gitlab # [ 429.798582] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.571Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d65221581af01b06f770425c","created_at":"2026-09-08T06:01:39.812Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6d49e3eca8d70b223f5c7b289eae221","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.834Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d65221581af01b06f770425c: start","job_status":"start","queue_duration_s":0.736258,"scheduling_latency_s":0.736309}2155gitlab # [ 429.816857] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.646Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2156gitlab # [ 429.853781] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.710Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d65221581af01b06f770425c","created_at":"2026-09-08T06:01:39.812Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6d49e3eca8d70b223f5c7b289eae221","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.834Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d65221581af01b06f770425c: done: 0.139316 sec","job_status":"done","queue_duration_s":0.736258,"scheduling_latency_s":0.736309,"redis_calls":9,"redis_duration_s":0.040257,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.034738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.139316,"completed_at":"2026-09-08T06:01:40.710Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2157gitlab # [ 429.949281] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6f06e674d8c16ab6e936d352","created_at":"2026-09-08T06:01:39.887Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04aafaa6ad3e3974429801fbf34af182","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.912Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6f06e674d8c16ab6e936d352: start","job_status":"start","queue_duration_s":0.84802,"scheduling_latency_s":0.848073}2158gitlab # [ 430.023267] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.880Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6f06e674d8c16ab6e936d352","created_at":"2026-09-08T06:01:39.887Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04aafaa6ad3e3974429801fbf34af182","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.912Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6f06e674d8c16ab6e936d352: done: 0.120068 sec","job_status":"done","queue_duration_s":0.84802,"scheduling_latency_s":0.848073,"redis_calls":11,"redis_duration_s":0.005457,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000854,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00223,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00142626,"exclusive_lock_hold_duration_s":0.04010626,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.120068,"completed_at":"2026-09-08T06:01:40.880Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2159gitlab # [ 430.116415] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.883Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f7eac468ed483159d370ed93","created_at":"2026-09-08T06:01:39.982Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2eb52b3ad2daafd2ea057f65a271fff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.991Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f7eac468ed483159d370ed93: start","job_status":"start","queue_duration_s":0.892016,"scheduling_latency_s":0.892061}2160gitlab # [ 430.158843] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.911Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2161gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses2162gitlab # [ 430.167454] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f7eac468ed483159d370ed93","created_at":"2026-09-08T06:01:39.982Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2eb52b3ad2daafd2ea057f65a271fff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:39.991Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f7eac468ed483159d370ed93: done: 0.044252 sec","job_status":"done","queue_duration_s":0.892016,"scheduling_latency_s":0.892061,"redis_calls":9,"redis_duration_s":0.0033959999999999997,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000865,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0007,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044252,"completed_at":"2026-09-08T06:01:40.927Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2163gitlab # [ 430.229598] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.930Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0a11c6fe7c93a100a46b0e87","created_at":"2026-09-08T06:01:40.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"727a6ad99eb0114c3e05c46afc8a5050","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.020Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0a11c6fe7c93a100a46b0e87: start","job_status":"start","queue_duration_s":0.910764,"scheduling_latency_s":0.910799}2164gitlab # [ 430.246716] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.976Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0a11c6fe7c93a100a46b0e87","created_at":"2026-09-08T06:01:40.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"727a6ad99eb0114c3e05c46afc8a5050","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.020Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0a11c6fe7c93a100a46b0e87: done: 0.045578 sec","job_status":"done","queue_duration_s":0.910764,"scheduling_latency_s":0.910799,"redis_calls":9,"redis_duration_s":0.002975,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00059,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001594,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000791,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045578,"completed_at":"2026-09-08T06:01:40.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165gitlab # [ 430.295949] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:40.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d299511c6da5723dea8eff6d","created_at":"2026-09-08T06:01:40.044Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8497475db022f5fb577e4cf508b41695","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.070Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d299511c6da5723dea8eff6d: start","job_status":"start","queue_duration_s":0.908352,"scheduling_latency_s":0.908383}2166gitlab # [ 430.363731] gitaly[910]: time="2026-09-08T06:01:41.220Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ8G66AR4MF9JYJMADT5C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:11.119" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:41.219" grpc.time_ms=0.88 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses, in 0.20 seconds)2168gitlab # [ 430.398830] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1292169gitlab # [ 430.557718] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d299511c6da5723dea8eff6d","created_at":"2026-09-08T06:01:40.044Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8497475db022f5fb577e4cf508b41695","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.070Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d299511c6da5723dea8eff6d: done: 0.436693 sec","job_status":"done","queue_duration_s":0.908352,"scheduling_latency_s":0.908383,"redis_calls":564,"redis_duration_s":0.097108,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000634,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.095229,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.381333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.436693,"completed_at":"2026-09-08T06:01:41.415Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2170gitlab # [ 430.652320] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.416Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5558f719c01c959aa3d2d782","created_at":"2026-09-08T06:01:40.088Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b087cf1e275e44d85ea14348b1e4354","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.103Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5558f719c01c959aa3d2d782: start","job_status":"start","queue_duration_s":1.313862,"scheduling_latency_s":1.313883}2171gitlab # [ 430.672512] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.429Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2172gitlab # [ 430.676792] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5558f719c01c959aa3d2d782","created_at":"2026-09-08T06:01:40.088Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b087cf1e275e44d85ea14348b1e4354","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.103Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5558f719c01c959aa3d2d782: done: 0.020713 sec","job_status":"done","queue_duration_s":1.313862,"scheduling_latency_s":1.313883,"redis_calls":9,"redis_duration_s":0.002254,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000551,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001242,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000461,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020713,"completed_at":"2026-09-08T06:01:41.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000715,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2173gitlab # [ 430.728547] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c13ce45545052b407db9ce69","created_at":"2026-09-08T06:01:40.117Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"449f42f578f927af4b7ff8cfe15e6671","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.143Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c13ce45545052b407db9ce69: start","job_status":"start","queue_duration_s":1.295852,"scheduling_latency_s":1.295869}2174gitlab # [ 430.742350] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.477Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c13ce45545052b407db9ce69","created_at":"2026-09-08T06:01:40.117Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"449f42f578f927af4b7ff8cfe15e6671","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.143Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c13ce45545052b407db9ce69: done: 0.038596 sec","job_status":"done","queue_duration_s":1.295852,"scheduling_latency_s":1.295869,"redis_calls":18,"redis_duration_s":0.005557,"redis_read_bytes":20,"redis_write_bytes":4702,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001423,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000401,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002957,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000776,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038596,"completed_at":"2026-09-08T06:01:41.477Z","load_balancing_strategy":"primary","db_duration_s":0.003833,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2175gitlab # [ 430.784093] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.479Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e863404408cdc72acfe40e82","created_at":"2026-09-08T06:01:40.168Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abde4aae40f6d720df648419daca8026","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.190Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e863404408cdc72acfe40e82: start","job_status":"start","queue_duration_s":1.28862,"scheduling_latency_s":1.288637}2176gitlab # [ 430.798686] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e863404408cdc72acfe40e82","created_at":"2026-09-08T06:01:40.168Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abde4aae40f6d720df648419daca8026","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.190Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e863404408cdc72acfe40e82: done: 0.023672 sec","job_status":"done","queue_duration_s":1.28862,"scheduling_latency_s":1.288637,"redis_calls":11,"redis_duration_s":0.002918,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001165,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000484,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023672,"completed_at":"2026-09-08T06:01:41.502Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2177gitlab # [ 430.841149] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.504Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"310a34a1ae7f59c2b111e10b","created_at":"2026-09-08T06:01:40.219Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1ed660d52a5a0ba9a96765959190479","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T06:01:40.237Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-310a34a1ae7f59c2b111e10b: start","job_status":"start","queue_duration_s":1.267206,"scheduling_latency_s":1.267223}2178gitlab # [ 430.881689] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.515Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2179gitlab # [ 430.890161] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"310a34a1ae7f59c2b111e10b","created_at":"2026-09-08T06:01:40.219Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1ed660d52a5a0ba9a96765959190479","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T06:01:40.237Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-310a34a1ae7f59c2b111e10b: done: 0.01838 sec","job_status":"done","queue_duration_s":1.267206,"scheduling_latency_s":1.267223,"redis_calls":9,"redis_duration_s":0.0021780000000000002,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00045,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01838,"completed_at":"2026-09-08T06:01:41.522Z","load_balancing_strategy":"primary","db_duration_s":0.000545,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2180gitlab # [ 430.952067] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.524Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"82b519df39dc568446182315","created_at":"2026-09-08T06:01:40.417Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f95de4d61b8de4e5c5a2e6eca581e7c9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.429Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-82b519df39dc568446182315: start","job_status":"start","queue_duration_s":1.09551,"scheduling_latency_s":1.095526}2181gitlab # [ 430.967273] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.544Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2182gitlab # [ 430.971023] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.562Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"82b519df39dc568446182315","created_at":"2026-09-08T06:01:40.417Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f95de4d61b8de4e5c5a2e6eca581e7c9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.429Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-82b519df39dc568446182315: done: 0.037446 sec","job_status":"done","queue_duration_s":1.09551,"scheduling_latency_s":1.095526,"redis_calls":9,"redis_duration_s":0.003939,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001073,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000622,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037446,"completed_at":"2026-09-08T06:01:41.561Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001026,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183gitlab # [ 431.013394] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.565Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"23e290343e92ab1a398201c0","created_at":"2026-09-08T06:01:40.435Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed62a594f91583676bdb0e7135dd63e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T06:01:40.451Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-23e290343e92ab1a398201c0: start","job_status":"start","queue_duration_s":1.114045,"scheduling_latency_s":1.114088}2184gitlab # [ 431.026380] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"23e290343e92ab1a398201c0","created_at":"2026-09-08T06:01:40.435Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed62a594f91583676bdb0e7135dd63e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T06:01:40.451Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-23e290343e92ab1a398201c0: done: 0.069608 sec","job_status":"done","queue_duration_s":1.114045,"scheduling_latency_s":1.114088,"redis_calls":9,"redis_duration_s":0.003748,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000789,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.069608,"completed_at":"2026-09-08T06:01:41.634Z","load_balancing_strategy":"primary","db_duration_s":0.009194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2185gitlab # [ 431.067079] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.638Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"71b0c0a9d066205850ccf036","created_at":"2026-09-08T06:01:40.474Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf074c397da690d93b1ed00bee9978bf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.494Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-71b0c0a9d066205850ccf036: start","job_status":"start","queue_duration_s":1.143273,"scheduling_latency_s":1.143313}2186gitlab # [ 431.096666] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.954Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"71b0c0a9d066205850ccf036","created_at":"2026-09-08T06:01:40.474Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf074c397da690d93b1ed00bee9978bf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.494Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-71b0c0a9d066205850ccf036: done: 0.316377 sec","job_status":"done","queue_duration_s":1.143273,"scheduling_latency_s":1.143313,"redis_calls":11,"redis_duration_s":0.004176,"redis_read_bytes":9,"redis_write_bytes":1292,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000793,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002056,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001327,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.053,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.242453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00087752,"exclusive_lock_hold_duration_s":0.2832645,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.316377,"completed_at":"2026-09-08T06:01:41.954Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.081312,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2187gitlab # [ 431.140951] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.956Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9cea85c96897d319c5a683f6","created_at":"2026-09-08T06:01:40.509Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e9657723946091c55ad8330e4e10267","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.516Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9cea85c96897d319c5a683f6: start","job_status":"start","queue_duration_s":1.439328,"scheduling_latency_s":1.439349}2188gitlab # [ 431.154607] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.983Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9cea85c96897d319c5a683f6","created_at":"2026-09-08T06:01:40.509Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e9657723946091c55ad8330e4e10267","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.516Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9cea85c96897d319c5a683f6: done: 0.027074 sec","job_status":"done","queue_duration_s":1.439328,"scheduling_latency_s":1.439349,"redis_calls":9,"redis_duration_s":0.002423,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000496,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001369,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027074,"completed_at":"2026-09-08T06:01:41.983Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00445,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2189gitlab # [ 431.195889] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:41.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"78c686ab0c8518a95b3b37ea","created_at":"2026-09-08T06:01:40.541Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.568Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-78c686ab0c8518a95b3b37ea: start","job_status":"start","queue_duration_s":1.416422,"scheduling_latency_s":1.41644}2190gitlab # [ 431.237659] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.095Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"78c686ab0c8518a95b3b37ea","created_at":"2026-09-08T06:01:40.541Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.568Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-78c686ab0c8518a95b3b37ea: done: 0.110557 sec","job_status":"done","queue_duration_s":1.416422,"scheduling_latency_s":1.41644,"redis_calls":70,"redis_duration_s":0.017658,"redis_read_bytes":118,"redis_write_bytes":42530,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002428,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.00077,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013759,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000701,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.110557,"completed_at":"2026-09-08T06:01:42.095Z","load_balancing_strategy":"primary","db_duration_s":0.00279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2191gitlab # [ 431.280920] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.097Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c28048904e09f5237d03fa87","created_at":"2026-09-08T06:01:40.577Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09724530c14018774adf6c1f9d783759","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.588Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c28048904e09f5237d03fa87: start","job_status":"start","queue_duration_s":1.508963,"scheduling_latency_s":1.508982}2192gitlab # [ 431.294953] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.120Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c28048904e09f5237d03fa87","created_at":"2026-09-08T06:01:40.577Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09724530c14018774adf6c1f9d783759","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.588Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c28048904e09f5237d03fa87: done: 0.023446 sec","job_status":"done","queue_duration_s":1.508963,"scheduling_latency_s":1.508982,"redis_calls":11,"redis_duration_s":0.00263,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00054474,"exclusive_lock_hold_duration_s":0.00364222,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.023446,"completed_at":"2026-09-08T06:01:42.120Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2193gitlab # [ 431.337627] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f507c7f16630a91888d32ff4","created_at":"2026-09-08T06:01:40.603Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa8415c03b3540c208d7e361f59eef4b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.632Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f507c7f16630a91888d32ff4: start","job_status":"start","queue_duration_s":1.489037,"scheduling_latency_s":1.489054}2194gitlab # [ 431.352219] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.141Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f507c7f16630a91888d32ff4","created_at":"2026-09-08T06:01:40.603Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa8415c03b3540c208d7e361f59eef4b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:40.632Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f507c7f16630a91888d32ff4: done: 0.019384 sec","job_status":"done","queue_duration_s":1.489037,"scheduling_latency_s":1.489054,"redis_calls":9,"redis_duration_s":0.00209,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000445,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019384,"completed_at":"2026-09-08T06:01:42.141Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000596,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2195gitlab # [ 431.394051] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.142Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3b500c0c2ed6f95ae644a58c","created_at":"2026-09-08T06:01:40.678Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22a5692064b31a033743b4931a8e943b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T06:01:40.703Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3b500c0c2ed6f95ae644a58c: start","job_status":"start","queue_duration_s":1.438909,"scheduling_latency_s":1.438928}2196gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses2197gitlab # [ 431.407361] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.153Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2198gitlab # [ 431.411002] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.161Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3b500c0c2ed6f95ae644a58c","created_at":"2026-09-08T06:01:40.678Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-50ea9b61506346be","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22a5692064b31a033743b4931a8e943b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T06:01:40.703Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3b500c0c2ed6f95ae644a58c: done: 0.018809 sec","job_status":"done","queue_duration_s":1.438909,"scheduling_latency_s":1.438928,"redis_calls":9,"redis_duration_s":0.002534,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001234,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000819,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018809,"completed_at":"2026-09-08T06:01:42.161Z","load_balancing_strategy":"primary","db_duration_s":0.000558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2199gitlab # [ 431.450437] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.163Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f3a2c5266d729fbbcd122575","created_at":"2026-09-08T06:01:41.456Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-ed80a7e217914e7b","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"449f42f578f927af4b7ff8cfe15e6671","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:41.470Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f3a2c5266d729fbbcd122575: start","job_status":"start","queue_duration_s":0.692892,"scheduling_latency_s":0.692911}2200gitlab # [ 431.462506] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.179Z","message":"No existing merge request to be cleaned up."}2201gitlab # [ 431.464114] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.194Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f3a2c5266d729fbbcd122575","created_at":"2026-09-08T06:01:41.456Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-ed80a7e217914e7b","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"449f42f578f927af4b7ff8cfe15e6671","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:41.470Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f3a2c5266d729fbbcd122575: done: 0.031757 sec","job_status":"done","queue_duration_s":0.692892,"scheduling_latency_s":0.692911,"redis_calls":12,"redis_duration_s":0.0030540000000000003,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000446,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001564,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031757,"completed_at":"2026-09-08T06:01:42.194Z","load_balancing_strategy":"primary","db_duration_s":0.005432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2202gitlab # [ 431.505260] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.196Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"24b824508562db09b3bb04bf","created_at":"2026-09-08T06:01:41.456Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-ed80a7e217914e7b","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"449f42f578f927af4b7ff8cfe15e6671","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:41.470Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-24b824508562db09b3bb04bf: start","job_status":"start","queue_duration_s":0.726108,"scheduling_latency_s":0.726126}2203gitlab # [ 431.517396] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.208Z","message":"No existing merge request to be cleaned up."}2204gitlab # [ 431.519047] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.217Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"24b824508562db09b3bb04bf","created_at":"2026-09-08T06:01:41.456Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-ed80a7e217914e7b","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"449f42f578f927af4b7ff8cfe15e6671","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:41.470Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-24b824508562db09b3bb04bf: done: 0.02149 sec","job_status":"done","queue_duration_s":0.726108,"scheduling_latency_s":0.726126,"redis_calls":10,"redis_duration_s":0.002452,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001464,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02149,"completed_at":"2026-09-08T06:01:42.217Z","load_balancing_strategy":"primary","db_duration_s":0.002371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2205gitlab # [ 431.557756] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.219Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b9bfacf7415fbeeee869cfc4","created_at":"2026-09-08T06:01:41.456Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-ed80a7e217914e7b","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"449f42f578f927af4b7ff8cfe15e6671","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:41.470Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b9bfacf7415fbeeee869cfc4: start","job_status":"start","queue_duration_s":0.749146,"scheduling_latency_s":0.749165}2206gitlab # [ 431.569807] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.231Z","message":"No existing merge request to be cleaned up."}2207gitlab # [ 431.571456] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.241Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b9bfacf7415fbeeee869cfc4","created_at":"2026-09-08T06:01:41.456Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-ed80a7e217914e7b","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"449f42f578f927af4b7ff8cfe15e6671","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:41.470Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b9bfacf7415fbeeee869cfc4: done: 0.022003 sec","job_status":"done","queue_duration_s":0.749146,"scheduling_latency_s":0.749165,"redis_calls":10,"redis_duration_s":0.003083,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00156,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001523,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022003,"completed_at":"2026-09-08T06:01:42.241Z","load_balancing_strategy":"primary","db_duration_s":0.002604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2208gitlab # [ 431.609824] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.242Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f5246d0cf6e243838653f96","created_at":"2026-09-08T06:01:41.456Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-ed80a7e217914e7b","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"449f42f578f927af4b7ff8cfe15e6671","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:41.470Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f5246d0cf6e243838653f96: start","job_status":"start","queue_duration_s":0.772511,"scheduling_latency_s":0.772528}2209gitlab # [ 431.621758] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.255Z","message":"No existing merge request to be cleaned up."}2210gitlab # [ 431.623706] gitaly[910]: time="2026-09-08T06:01:42.428Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQ9NFH84J8R6GVS6WHZX2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:12.425" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:42.426" grpc.time_ms=1.485 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2211gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses, in 0.25 seconds)2212gitlab # [ 431.636536] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.264Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f5246d0cf6e243838653f96","created_at":"2026-09-08T06:01:41.456Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-ed80a7e217914e7b","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"449f42f578f927af4b7ff8cfe15e6671","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:41.470Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f5246d0cf6e243838653f96: done: 0.021886 sec","job_status":"done","queue_duration_s":0.772511,"scheduling_latency_s":0.772528,"redis_calls":10,"redis_duration_s":0.002576,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001489,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021886,"completed_at":"2026-09-08T06:01:42.264Z","load_balancing_strategy":"primary","db_duration_s":0.002851,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2213gitlab # [ 431.674191] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3871636ee6b03ba5f3b47a33","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3871636ee6b03ba5f3b47a33: start","job_status":"start","queue_duration_s":0.179741,"scheduling_latency_s":0.179759}2214gitlab # [ 431.687235] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3871636ee6b03ba5f3b47a33","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3871636ee6b03ba5f3b47a33: done: 0.028003 sec","job_status":"done","queue_duration_s":0.179741,"scheduling_latency_s":0.179759,"redis_calls":15,"redis_duration_s":0.0042710000000000005,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000592,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002726,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028003,"completed_at":"2026-09-08T06:01:42.294Z","load_balancing_strategy":"primary","db_duration_s":0.000608,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2215gitlab # [ 431.727760] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"131ff5f12820bd59e5049fca","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-131ff5f12820bd59e5049fca: start","job_status":"start","queue_duration_s":0.213862,"scheduling_latency_s":0.213913}2216gitlab # [ 431.740525] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1792217gitlab # [ 431.743093] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"131ff5f12820bd59e5049fca","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-131ff5f12820bd59e5049fca: done: 0.033503 sec","job_status":"done","queue_duration_s":0.213862,"scheduling_latency_s":0.213913,"redis_calls":13,"redis_duration_s":0.005069000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003023,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033503,"completed_at":"2026-09-08T06:01:42.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2218gitlab # [ 431.781864] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a6b7bbd152b7f8332b261ef","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a6b7bbd152b7f8332b261ef: start","job_status":"start","queue_duration_s":0.249236,"scheduling_latency_s":0.249255}2219gitlab # [ 431.793941] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a6b7bbd152b7f8332b261ef","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a6b7bbd152b7f8332b261ef: done: 0.0192 sec","job_status":"done","queue_duration_s":0.249236,"scheduling_latency_s":0.249255,"redis_calls":13,"redis_duration_s":0.0027949999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001816,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0192,"completed_at":"2026-09-08T06:01:42.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2220gitlab # [ 431.832806] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13352c78272d80a1804d97b5","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13352c78272d80a1804d97b5: start","job_status":"start","queue_duration_s":0.271448,"scheduling_latency_s":0.271468}2221gitlab # [ 431.845181] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13352c78272d80a1804d97b5","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13352c78272d80a1804d97b5: done: 0.022935 sec","job_status":"done","queue_duration_s":0.271448,"scheduling_latency_s":0.271468,"redis_calls":13,"redis_duration_s":0.006716,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004785,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022935,"completed_at":"2026-09-08T06:01:42.381Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2222gitlab # [ 431.883642] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f43b3b1d63d274aca092433e","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f43b3b1d63d274aca092433e: start","job_status":"start","queue_duration_s":0.297013,"scheduling_latency_s":0.297039}2223gitlab # [ 431.897106] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f43b3b1d63d274aca092433e","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f43b3b1d63d274aca092433e: done: 0.019534 sec","job_status":"done","queue_duration_s":0.297013,"scheduling_latency_s":0.297039,"redis_calls":13,"redis_duration_s":0.0032170000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019534,"completed_at":"2026-09-08T06:01:42.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2224gitlab # [ 431.935726] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7983e2c805f2805586d55ce2","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7983e2c805f2805586d55ce2: start","job_status":"start","queue_duration_s":0.318919,"scheduling_latency_s":0.318939}2225gitlab # [ 431.948234] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7983e2c805f2805586d55ce2","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7983e2c805f2805586d55ce2: done: 0.019639 sec","job_status":"done","queue_duration_s":0.318919,"scheduling_latency_s":0.318939,"redis_calls":13,"redis_duration_s":0.00297,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001024,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019639,"completed_at":"2026-09-08T06:01:42.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2226gitlab # [ 431.986830] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cfd868d2b0256f59facff11","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cfd868d2b0256f59facff11: start","job_status":"start","queue_duration_s":0.342647,"scheduling_latency_s":0.342667}2227gitlab # [ 432.022089] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cfd868d2b0256f59facff11","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cfd868d2b0256f59facff11: done: 0.021053 sec","job_status":"done","queue_duration_s":0.342647,"scheduling_latency_s":0.342667,"redis_calls":13,"redis_duration_s":0.005093,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021053,"completed_at":"2026-09-08T06:01:42.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2228gitlab # [ 432.083454] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bee9e06c287079dd1a103390","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bee9e06c287079dd1a103390: start","job_status":"start","queue_duration_s":0.365678,"scheduling_latency_s":0.365698}2229gitlab # [ 432.098320] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bee9e06c287079dd1a103390","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bee9e06c287079dd1a103390: done: 0.022925 sec","job_status":"done","queue_duration_s":0.365678,"scheduling_latency_s":0.365698,"redis_calls":13,"redis_duration_s":0.007229,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005763,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022925,"completed_at":"2026-09-08T06:01:42.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2230gitlab # [ 432.146594] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc27fe5aa24c389ff468161","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc27fe5aa24c389ff468161: start","job_status":"start","queue_duration_s":0.39007,"scheduling_latency_s":0.390089}2231gitlab # [ 432.160634] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc27fe5aa24c389ff468161","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc27fe5aa24c389ff468161: done: 0.01858 sec","job_status":"done","queue_duration_s":0.39007,"scheduling_latency_s":0.390089,"redis_calls":13,"redis_duration_s":0.003472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002472,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01858,"completed_at":"2026-09-08T06:01:42.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2232gitlab # [ 432.199514] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d508674cbc1052441fb9b876","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d508674cbc1052441fb9b876: start","job_status":"start","queue_duration_s":0.41009,"scheduling_latency_s":0.410107}2233gitlab # [ 432.211928] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d508674cbc1052441fb9b876","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d508674cbc1052441fb9b876: done: 0.018977 sec","job_status":"done","queue_duration_s":0.41009,"scheduling_latency_s":0.410107,"redis_calls":13,"redis_duration_s":0.003476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002471,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018977,"completed_at":"2026-09-08T06:01:42.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 432.250460] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e19f6d194c332c9153315b58","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e19f6d194c332c9153315b58: start","job_status":"start","queue_duration_s":0.430428,"scheduling_latency_s":0.430445}2235gitlab # [ 432.262433] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e19f6d194c332c9153315b58","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e19f6d194c332c9153315b58: done: 0.017401 sec","job_status":"done","queue_duration_s":0.430428,"scheduling_latency_s":0.430445,"redis_calls":13,"redis_duration_s":0.002735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001757,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017401,"completed_at":"2026-09-08T06:01:42.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2236gitlab # [ 432.300884] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7ce715e1f7e88b684a5f157","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7ce715e1f7e88b684a5f157: start","job_status":"start","queue_duration_s":0.449243,"scheduling_latency_s":0.449261}2237gitlab # [ 432.313930] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7ce715e1f7e88b684a5f157","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7ce715e1f7e88b684a5f157: done: 0.017079 sec","job_status":"done","queue_duration_s":0.449243,"scheduling_latency_s":0.449261,"redis_calls":13,"redis_duration_s":0.0028980000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001079,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001819,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017079,"completed_at":"2026-09-08T06:01:42.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2238gitlab # [ 432.352394] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8d5a7c06e52607137bcae2a","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8d5a7c06e52607137bcae2a: start","job_status":"start","queue_duration_s":0.467652,"scheduling_latency_s":0.46767}2239gitlab # [ 432.364289] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8d5a7c06e52607137bcae2a","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8d5a7c06e52607137bcae2a: done: 0.018014 sec","job_status":"done","queue_duration_s":0.467652,"scheduling_latency_s":0.46767,"redis_calls":13,"redis_duration_s":0.003863,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002484,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018014,"completed_at":"2026-09-08T06:01:42.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2240gitlab # [ 432.402818] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfcd5873cf15abc3d631e25c","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfcd5873cf15abc3d631e25c: start","job_status":"start","queue_duration_s":0.487553,"scheduling_latency_s":0.487572}2241gitlab # [ 432.414898] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfcd5873cf15abc3d631e25c","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfcd5873cf15abc3d631e25c: done: 0.017076 sec","job_status":"done","queue_duration_s":0.487553,"scheduling_latency_s":0.487572,"redis_calls":13,"redis_duration_s":0.0027990000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017076,"completed_at":"2026-09-08T06:01:42.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2242gitlab # [ 432.453469] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54820119b832043ca1afe48f","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54820119b832043ca1afe48f: start","job_status":"start","queue_duration_s":0.506884,"scheduling_latency_s":0.506902}2243gitlab # [ 432.465761] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54820119b832043ca1afe48f","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54820119b832043ca1afe48f: done: 0.017148 sec","job_status":"done","queue_duration_s":0.506884,"scheduling_latency_s":0.506902,"redis_calls":13,"redis_duration_s":0.002693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001756,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017148,"completed_at":"2026-09-08T06:01:42.610Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2244gitlab # [ 432.504123] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08dce3c4511423fd88073b02","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08dce3c4511423fd88073b02: start","job_status":"start","queue_duration_s":0.525706,"scheduling_latency_s":0.525724}2245gitlab # [ 432.516899] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08dce3c4511423fd88073b02","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08dce3c4511423fd88073b02: done: 0.017032 sec","job_status":"done","queue_duration_s":0.525706,"scheduling_latency_s":0.525724,"redis_calls":13,"redis_duration_s":0.002723,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017032,"completed_at":"2026-09-08T06:01:42.629Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2246gitlab # [ 432.555079] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c4dab14a43ccee85a6f8c49","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c4dab14a43ccee85a6f8c49: start","job_status":"start","queue_duration_s":0.544573,"scheduling_latency_s":0.544593}2247gitlab # [ 432.567285] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c4dab14a43ccee85a6f8c49","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c4dab14a43ccee85a6f8c49: done: 0.016755 sec","job_status":"done","queue_duration_s":0.544573,"scheduling_latency_s":0.544593,"redis_calls":13,"redis_duration_s":0.002602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001701,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016755,"completed_at":"2026-09-08T06:01:42.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2248gitlab # [ 432.605881] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e55904a41452af0aaa12bd5","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e55904a41452af0aaa12bd5: start","job_status":"start","queue_duration_s":0.563142,"scheduling_latency_s":0.563161}2249gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses2250gitlab # [ 432.618247] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e55904a41452af0aaa12bd5","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e55904a41452af0aaa12bd5: done: 0.018037 sec","job_status":"done","queue_duration_s":0.563142,"scheduling_latency_s":0.563161,"redis_calls":13,"redis_duration_s":0.003522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002549,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018037,"completed_at":"2026-09-08T06:01:42.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2251gitlab # [ 432.656387] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4174eb48ad9b84c434926a37","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4174eb48ad9b84c434926a37: start","job_status":"start","queue_duration_s":0.582536,"scheduling_latency_s":0.582553}2252gitlab # [ 432.667897] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4174eb48ad9b84c434926a37","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4174eb48ad9b84c434926a37: done: 0.018052 sec","job_status":"done","queue_duration_s":0.582536,"scheduling_latency_s":0.582553,"redis_calls":13,"redis_duration_s":0.002934,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018052,"completed_at":"2026-09-08T06:01:42.687Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2253gitlab # [ 432.704706] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c470ce30f9b4a419e1537618","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c470ce30f9b4a419e1537618: start","job_status":"start","queue_duration_s":0.601985,"scheduling_latency_s":0.602003}2254gitlab # [ 432.716923] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c470ce30f9b4a419e1537618","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c470ce30f9b4a419e1537618: done: 0.021113 sec","job_status":"done","queue_duration_s":0.601985,"scheduling_latency_s":0.602003,"redis_calls":13,"redis_duration_s":0.003055,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001172,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021113,"completed_at":"2026-09-08T06:01:42.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2255gitlab # [ 432.756136] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03abc54ed38501c48162576f","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03abc54ed38501c48162576f: start","job_status":"start","queue_duration_s":0.625938,"scheduling_latency_s":0.625981}2256gitlab # [ 432.768352] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03abc54ed38501c48162576f","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03abc54ed38501c48162576f: done: 0.034822 sec","job_status":"done","queue_duration_s":0.625938,"scheduling_latency_s":0.625981,"redis_calls":13,"redis_duration_s":0.003096,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034822,"completed_at":"2026-09-08T06:01:42.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2257gitlab # [ 432.807416] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b97b35a991dda004c9efffd2","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b97b35a991dda004c9efffd2: start","job_status":"start","queue_duration_s":0.662759,"scheduling_latency_s":0.662792}2258gitlab # [ 432.819839] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b97b35a991dda004c9efffd2","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b97b35a991dda004c9efffd2: done: 0.025057 sec","job_status":"done","queue_duration_s":0.662759,"scheduling_latency_s":0.662792,"redis_calls":13,"redis_duration_s":0.0030299999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025057,"completed_at":"2026-09-08T06:01:42.774Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2259gitlab # [ 432.858794] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"446bf86e6ce3b18ff1d9e9ad","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-446bf86e6ce3b18ff1d9e9ad: start","job_status":"start","queue_duration_s":0.689536,"scheduling_latency_s":0.689561}2260gitlab # [ 432.871339] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"446bf86e6ce3b18ff1d9e9ad","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-446bf86e6ce3b18ff1d9e9ad: done: 0.019917 sec","job_status":"done","queue_duration_s":0.689536,"scheduling_latency_s":0.689561,"redis_calls":13,"redis_duration_s":0.002824,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001801,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019917,"completed_at":"2026-09-08T06:01:42.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2261gitlab # [ 432.910369] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a2322af7ebc88a12f19c7c7","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a2322af7ebc88a12f19c7c7: start","job_status":"start","queue_duration_s":0.711227,"scheduling_latency_s":0.711248}2262gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses, in 0.28 seconds)2263gitlab # [ 432.923135] gitaly[910]: time="2026-09-08T06:01:43.720Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQAXXPB0QYTV3W5GJ3TD8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:13.717" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:43.718" grpc.time_ms=1.37 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2264gitlab # [ 432.936756] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1612265gitlab # [ 432.939346] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a2322af7ebc88a12f19c7c7","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a2322af7ebc88a12f19c7c7: done: 0.018345 sec","job_status":"done","queue_duration_s":0.711227,"scheduling_latency_s":0.711248,"redis_calls":13,"redis_duration_s":0.00317,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018345,"completed_at":"2026-09-08T06:01:42.816Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2266gitlab # [ 432.977771] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"193863f65263043c0b624897","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-193863f65263043c0b624897: start","job_status":"start","queue_duration_s":0.731066,"scheduling_latency_s":0.731086}2267gitlab # [ 432.990043] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"193863f65263043c0b624897","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-193863f65263043c0b624897: done: 0.01777 sec","job_status":"done","queue_duration_s":0.731066,"scheduling_latency_s":0.731086,"redis_calls":13,"redis_duration_s":0.002954,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01777,"completed_at":"2026-09-08T06:01:42.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2268gitlab # [ 433.028595] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b925100125e6b0583427757","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b925100125e6b0583427757: start","job_status":"start","queue_duration_s":0.750356,"scheduling_latency_s":0.750376}2269gitlab # [ 433.040852] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b925100125e6b0583427757","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b925100125e6b0583427757: done: 0.01636 sec","job_status":"done","queue_duration_s":0.750356,"scheduling_latency_s":0.750376,"redis_calls":13,"redis_duration_s":0.0020599999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001259,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01636,"completed_at":"2026-09-08T06:01:42.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2270gitlab # [ 433.079473] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61c2c5a6abc677e3dedefca7","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61c2c5a6abc677e3dedefca7: start","job_status":"start","queue_duration_s":0.76791,"scheduling_latency_s":0.767928}2271gitlab # [ 433.091895] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61c2c5a6abc677e3dedefca7","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61c2c5a6abc677e3dedefca7: done: 0.015565 sec","job_status":"done","queue_duration_s":0.76791,"scheduling_latency_s":0.767928,"redis_calls":13,"redis_duration_s":0.0017980000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015565,"completed_at":"2026-09-08T06:01:42.870Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2272gitlab # [ 433.131374] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"049343a06eabb81df1204029","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-049343a06eabb81df1204029: start","job_status":"start","queue_duration_s":0.784714,"scheduling_latency_s":0.784733}2273gitlab # [ 433.144853] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"049343a06eabb81df1204029","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-049343a06eabb81df1204029: done: 0.015338 sec","job_status":"done","queue_duration_s":0.784714,"scheduling_latency_s":0.784733,"redis_calls":13,"redis_duration_s":0.001885,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001222,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015338,"completed_at":"2026-09-08T06:01:42.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2274gitlab # [ 433.183636] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcc428551fb2efb683d441a0","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcc428551fb2efb683d441a0: start","job_status":"start","queue_duration_s":0.801273,"scheduling_latency_s":0.801291}2275gitlab # [ 433.196487] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcc428551fb2efb683d441a0","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcc428551fb2efb683d441a0: done: 0.014282 sec","job_status":"done","queue_duration_s":0.801273,"scheduling_latency_s":0.801291,"redis_calls":13,"redis_duration_s":0.001886,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014282,"completed_at":"2026-09-08T06:01:42.902Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2276gitlab # [ 433.236351] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44d4bf959f9dc47ee7c7e504","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44d4bf959f9dc47ee7c7e504: start","job_status":"start","queue_duration_s":0.816744,"scheduling_latency_s":0.816761}2277gitlab # [ 433.248900] nix-daemon[3721]: accepted connection from pid 4783, user nixbot2278gitlab # [ 433.249824] nix-daemon[3721]: accepted connection from pid 4746, user nixbot2279gitlab # [ 433.250756] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44d4bf959f9dc47ee7c7e504","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44d4bf959f9dc47ee7c7e504: done: 0.014509 sec","job_status":"done","queue_duration_s":0.816744,"scheduling_latency_s":0.816761,"redis_calls":13,"redis_duration_s":0.0023769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000802,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001575,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014509,"completed_at":"2026-09-08T06:01:42.917Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2280gitlab # [ 433.289956] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b910238cecf47a2516cc4912","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b910238cecf47a2516cc4912: start","job_status":"start","queue_duration_s":0.832496,"scheduling_latency_s":0.832513}2281gitlab # [ 433.302203] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b910238cecf47a2516cc4912","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b910238cecf47a2516cc4912: done: 0.037034 sec","job_status":"done","queue_duration_s":0.832496,"scheduling_latency_s":0.832513,"redis_calls":13,"redis_duration_s":0.004738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037034,"completed_at":"2026-09-08T06:01:42.956Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2282gitlab # [ 433.341388] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db43d66e08beafca96be8a61","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db43d66e08beafca96be8a61: start","job_status":"start","queue_duration_s":0.872393,"scheduling_latency_s":0.872432}2283gitlab # [ 433.355076] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db43d66e08beafca96be8a61","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db43d66e08beafca96be8a61: done: 0.031726 sec","job_status":"done","queue_duration_s":0.872393,"scheduling_latency_s":0.872432,"redis_calls":13,"redis_duration_s":0.00385,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001345,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002505,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031726,"completed_at":"2026-09-08T06:01:42.990Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2284gitlab # [ 433.394016] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:42.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6db8f3d67a90d753f1ea98aa","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6db8f3d67a90d753f1ea98aa: start","job_status":"start","queue_duration_s":0.906097,"scheduling_latency_s":0.906126}2285gitlab # [ 433.406213] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6db8f3d67a90d753f1ea98aa","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6db8f3d67a90d753f1ea98aa: done: 0.022671 sec","job_status":"done","queue_duration_s":0.906097,"scheduling_latency_s":0.906126,"redis_calls":13,"redis_duration_s":0.003121,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001081,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022671,"completed_at":"2026-09-08T06:01:43.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab # [ 433.444894] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de603219d5738594d74a753e","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de603219d5738594d74a753e: start","job_status":"start","queue_duration_s":0.930479,"scheduling_latency_s":0.9305}2287gitlab # [ 433.457035] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de603219d5738594d74a753e","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de603219d5738594d74a753e: done: 0.019227 sec","job_status":"done","queue_duration_s":0.930479,"scheduling_latency_s":0.9305,"redis_calls":13,"redis_duration_s":0.003072,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001135,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019227,"completed_at":"2026-09-08T06:01:43.036Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 433.495857] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b2d43ae72f179c4b80aac19","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b2d43ae72f179c4b80aac19: start","job_status":"start","queue_duration_s":0.951313,"scheduling_latency_s":0.951335}2289gitlab # [ 433.508204] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b2d43ae72f179c4b80aac19","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b2d43ae72f179c4b80aac19: done: 0.018871 sec","job_status":"done","queue_duration_s":0.951313,"scheduling_latency_s":0.951335,"redis_calls":13,"redis_duration_s":0.002933,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000985,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018871,"completed_at":"2026-09-08T06:01:43.056Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2290gitlab # [ 433.546921] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8623664280d7702ce31b4bc2","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8623664280d7702ce31b4bc2: start","job_status":"start","queue_duration_s":0.971839,"scheduling_latency_s":0.971865}2291gitlab # [ 433.565691] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8623664280d7702ce31b4bc2","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8623664280d7702ce31b4bc2: done: 0.018554 sec","job_status":"done","queue_duration_s":0.971839,"scheduling_latency_s":0.971865,"redis_calls":13,"redis_duration_s":0.003278,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001026,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002252,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018554,"completed_at":"2026-09-08T06:01:43.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2292gitlab # [ 433.604319] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77d3caf1bbbec834435b7a3b","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77d3caf1bbbec834435b7a3b: start","job_status":"start","queue_duration_s":0.99193,"scheduling_latency_s":0.99195}2293gitlab # [ 433.616610] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77d3caf1bbbec834435b7a3b","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77d3caf1bbbec834435b7a3b: done: 0.017659 sec","job_status":"done","queue_duration_s":0.99193,"scheduling_latency_s":0.99195,"redis_calls":13,"redis_duration_s":0.002916,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017659,"completed_at":"2026-09-08T06:01:43.096Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2294gitlab # [ 433.655369] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ff1aaa9ca083eaafa2eab89","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ff1aaa9ca083eaafa2eab89: start","job_status":"start","queue_duration_s":1.01107,"scheduling_latency_s":1.011089}2295gitlab # [ 433.667525] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ff1aaa9ca083eaafa2eab89","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ff1aaa9ca083eaafa2eab89: done: 0.01577 sec","job_status":"done","queue_duration_s":1.01107,"scheduling_latency_s":1.011089,"redis_calls":13,"redis_duration_s":0.002755,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001843,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01577,"completed_at":"2026-09-08T06:01:43.113Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 433.705554] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13b09f7c58efd03af29ca376","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13b09f7c58efd03af29ca376: start","job_status":"start","queue_duration_s":1.028194,"scheduling_latency_s":1.028211}2297gitlab # [ 433.717647] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13b09f7c58efd03af29ca376","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13b09f7c58efd03af29ca376: done: 0.014671 sec","job_status":"done","queue_duration_s":1.028194,"scheduling_latency_s":1.028211,"redis_calls":13,"redis_duration_s":0.002589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001713,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014671,"completed_at":"2026-09-08T06:01:43.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2298gitlab # [ 433.755879] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaf0cfcf74f3e948f158f539","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaf0cfcf74f3e948f158f539: start","job_status":"start","queue_duration_s":1.044224,"scheduling_latency_s":1.044241}2299gitlab # [ 433.769273] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaf0cfcf74f3e948f158f539","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaf0cfcf74f3e948f158f539: done: 0.014693 sec","job_status":"done","queue_duration_s":1.044224,"scheduling_latency_s":1.044241,"redis_calls":13,"redis_duration_s":0.002649,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014693,"completed_at":"2026-09-08T06:01:43.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 433.807391] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7910b75d99f3139fa0f0ce36","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7910b75d99f3139fa0f0ce36: start","job_status":"start","queue_duration_s":1.060172,"scheduling_latency_s":1.060189}2301gitlab # [ 433.819631] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7910b75d99f3139fa0f0ce36","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7910b75d99f3139fa0f0ce36: done: 0.01462 sec","job_status":"done","queue_duration_s":1.060172,"scheduling_latency_s":1.060189,"redis_calls":13,"redis_duration_s":0.002584,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001675,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01462,"completed_at":"2026-09-08T06:01:43.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2302gitlab # [ 433.857796] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"439431ecdec745e09c0791df","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-439431ecdec745e09c0791df: start","job_status":"start","queue_duration_s":1.07623,"scheduling_latency_s":1.076248}2303gitlab # [ 433.870318] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"439431ecdec745e09c0791df","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-439431ecdec745e09c0791df: done: 0.015294 sec","job_status":"done","queue_duration_s":1.07623,"scheduling_latency_s":1.076248,"redis_calls":13,"redis_duration_s":0.00275,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001838,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015294,"completed_at":"2026-09-08T06:01:43.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2304gitlab # [ 433.908174] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99ef3b3bdc4315d321090d9b","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99ef3b3bdc4315d321090d9b: start","job_status":"start","queue_duration_s":1.093086,"scheduling_latency_s":1.093104}2305gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses2306gitlab # [ 433.920198] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99ef3b3bdc4315d321090d9b","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99ef3b3bdc4315d321090d9b: done: 0.014845 sec","job_status":"done","queue_duration_s":1.093086,"scheduling_latency_s":1.093104,"redis_calls":13,"redis_duration_s":0.002647,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001718,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014845,"completed_at":"2026-09-08T06:01:43.194Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2307gitlab # [ 433.956699] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f20a72dfb48f74d9fb0d1156","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f20a72dfb48f74d9fb0d1156: start","job_status":"start","queue_duration_s":1.109327,"scheduling_latency_s":1.109344}2308gitlab # [ 433.968808] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f20a72dfb48f74d9fb0d1156","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f20a72dfb48f74d9fb0d1156: done: 0.014726 sec","job_status":"done","queue_duration_s":1.109327,"scheduling_latency_s":1.109344,"redis_calls":13,"redis_duration_s":0.002574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001694,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014726,"completed_at":"2026-09-08T06:01:43.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2309gitlab # [ 434.006909] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e12d6fd8dea52a89e143ea48","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e12d6fd8dea52a89e143ea48: start","job_status":"start","queue_duration_s":1.125363,"scheduling_latency_s":1.12538}2310gitlab # [ 434.019199] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e12d6fd8dea52a89e143ea48","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e12d6fd8dea52a89e143ea48: done: 0.014653 sec","job_status":"done","queue_duration_s":1.125363,"scheduling_latency_s":1.12538,"redis_calls":13,"redis_duration_s":0.0026,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00171,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014653,"completed_at":"2026-09-08T06:01:43.226Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2311gitlab # [ 434.057767] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b546888adf8eaaad65882e9f","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b546888adf8eaaad65882e9f: start","job_status":"start","queue_duration_s":1.141358,"scheduling_latency_s":1.141375}2312gitlab # [ 434.069902] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b546888adf8eaaad65882e9f","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b546888adf8eaaad65882e9f: done: 0.014839 sec","job_status":"done","queue_duration_s":1.141358,"scheduling_latency_s":1.141375,"redis_calls":13,"redis_duration_s":0.002675,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001764,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014839,"completed_at":"2026-09-08T06:01:43.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2313gitlab # [ 434.108262] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"548d6df3173da8a05cc402a8","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-548d6df3173da8a05cc402a8: start","job_status":"start","queue_duration_s":1.157522,"scheduling_latency_s":1.157539}2314gitlab # [ 434.120174] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"548d6df3173da8a05cc402a8","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-548d6df3173da8a05cc402a8: done: 0.014616 sec","job_status":"done","queue_duration_s":1.157522,"scheduling_latency_s":1.157539,"redis_calls":13,"redis_duration_s":0.002578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001697,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014616,"completed_at":"2026-09-08T06:01:43.258Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 434.158683] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0be0380280ddeccfdcbb19e5","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0be0380280ddeccfdcbb19e5: start","job_status":"start","queue_duration_s":1.173448,"scheduling_latency_s":1.173464}2316gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses, in 0.27 seconds)2317gitlab # [ 434.170711] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0be0380280ddeccfdcbb19e5","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0be0380280ddeccfdcbb19e5: done: 0.015125 sec","job_status":"done","queue_duration_s":1.173448,"scheduling_latency_s":1.173464,"redis_calls":13,"redis_duration_s":0.002982,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001259,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001723,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015125,"completed_at":"2026-09-08T06:01:43.275Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2318gitlab # [ 434.210336] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bf7000ea214f20a93cbc2e4","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bf7000ea214f20a93cbc2e4: start","job_status":"start","queue_duration_s":1.19013,"scheduling_latency_s":1.190146}2319gitlab # [ 434.222860] gitaly[910]: time="2026-09-08T06:01:44.986Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQC617FT7XGT3V65T7T2Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:14.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:44.985" grpc.time_ms=1.25 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2320gitlab # [ 434.235623] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1312321gitlab # [ 434.238349] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bf7000ea214f20a93cbc2e4","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bf7000ea214f20a93cbc2e4: done: 0.015108 sec","job_status":"done","queue_duration_s":1.19013,"scheduling_latency_s":1.190146,"redis_calls":13,"redis_duration_s":0.00303,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002135,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015108,"completed_at":"2026-09-08T06:01:43.291Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2322gitlab # [ 434.276600] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a61fb120bd31ad878c293fe","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a61fb120bd31ad878c293fe: start","job_status":"start","queue_duration_s":1.206573,"scheduling_latency_s":1.20659}2323gitlab # [ 434.288460] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:43.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a61fb120bd31ad878c293fe","created_at":"2026-09-08T06:01:42.006Z","trace_propagation_headers":{"sentry-trace":"26ccc350406a4266a4289780de884e9e-d7a3c263debe4b4a","baggage":"sentry-trace_id=26ccc350406a4266a4289780de884e9e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b873c56c070048ace63eec4759841d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T06:01:42.086Z","job_size_bytes":2,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a61fb120bd31ad878c293fe: done: 0.014924 sec","job_status":"done","queue_duration_s":1.206573,"scheduling_latency_s":1.20659,"redis_calls":13,"redis_duration_s":0.002811,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014924,"completed_at":"2026-09-08T06:01:43.308Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2324gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses2325gitlab # [ 435.350647] gitaly[910]: time="2026-09-08T06:01:46.207Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQDC4HZYVPRN6HDHTX3ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:16.105" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:46.206" grpc.time_ms=1.227 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2326gitlab # [ 435.409208] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1492327gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses, in 0.21 seconds)2328gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses2329gitlab # [ 436.522796] gitaly[910]: time="2026-09-08T06:01:47.380Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQEHNZ14CTTSTEZEA270C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:17.278" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:47.378" grpc.time_ms=1.214 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2330gitlab # [ 436.569246] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1092331gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses, in 0.16 seconds)2332gitlab # [ 437.270115] nix-daemon[3721]: accepted connection from pid 4746, user nixbot2333gitlab # [ 437.463900] gitaly[910]: time="2026-09-08T06:01:48.321Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:18.219" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:48.320" grpc.time_ms=1.318 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2334gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses2335gitlab # [ 437.569112] gitaly[910]: time="2026-09-08T06:01:48.425Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:58.026" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:48.407" grpc.time_ms=18.386 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab # [ 437.658819] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:48.515Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"774a1b0199e71c7426bf1998","created_at":"2026-09-08T06:01:48.500Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-59f42fa0e9b94526","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:48.508Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-774a1b0199e71c7426bf1998: start","job_status":"start","queue_duration_s":0.006484,"scheduling_latency_s":0.006548}2337gitlab # [ 437.702181] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3682338gitlab # [ 437.709787] nixbot[3554]: {"ts": "2026-09-08T06:01:48.560Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4473f91e6d2f683dd5adcb9621434f2b014dabca \"HTTP/1.1 201 Created\""}2339gitlab # [ 437.729960] gitaly[910]: time="2026-09-08T06:01:48.587Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQFP41T07NDRAQ53R41P3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:18.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:48.585" grpc.time_ms=1.528 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2340gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses, in 0.24 seconds)2341gitlab # [ 437.805283] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 1782342gitlab # [ 437.820585] gitaly[910]: time="2026-09-08T06:01:48.678Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQFRSXGGKAFS5R0FPNQER grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:18.576" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:48.676" grpc.time_ms=1.55 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2343gitlab # [ 437.913667] gitaly[910]: time="2026-09-08T06:01:48.771Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQFRSXGGKAFS5R0FPNQER grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:58.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:48.754" grpc.time_ms=16.664 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2344gitlab # [ 438.003428] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2912345gitlab # [ 438.012272] gitaly[910]: time="2026-09-08T06:01:48.861Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:48.860" grpc.time_ms=0.847 pid=910 span.kind=server system=grpc2346gitlab # [ 438.028601] nixbot[3554]: {"ts": "2026-09-08T06:01:48.862Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4473f91e6d2f683dd5adcb9621434f2b014dabca \"HTTP/1.1 201 Created\""}2347gitlab # [ 438.045613] gitaly[910]: time="2026-09-08T06:01:48.903Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:48.903" grpc.time_ms=0.572 pid=910 span.kind=server system=grpc2348gitlab # [ 438.081160] gitaly[910]: time="2026-09-08T06:01:48.939Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T06:01:48.938" grpc.time_ms=0.446 pid=910 span.kind=server system=grpc2349gitlab # [ 438.098336] gitaly[910]: time="2026-09-08T06:01:48.948Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T06:02:18.406" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:48.807" operations="[repack_refs]" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2350gitlab # [ 438.114396] gitaly[910]: time="2026-09-08T06:01:48.952Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T diskcache=5ce11988-3655-4b45-82df-9de4452b1ed5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T06:02:18.406" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:48.807" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2351gitlab # [ 438.128550] gitaly[910]: time="2026-09-08T06:01:48.952Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=144 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7217 command.oublock=0 command.real_time_ms=139 command.spawn_token_fork_ms=1 command.system_time_ms=94 command.user_time_ms=50 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T06:02:18.406" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:48.807" grpc.time_ms=145.122 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2352gitlab # [ 438.145670] gitaly[910]: time="2026-09-08T06:01:48.954Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T06:02:18.406" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:48.807" pid=910 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-08 05:59:56.1363738 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2353gitlab # [ 438.160552] gitaly[910]: time="2026-09-08T06:01:48.991Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQG2FZT627P46CVQZHXM8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:18.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:48.988" grpc.time_ms=3.006 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2354gitlab # [ 438.175194] gitaly[910]: time="2026-09-08T06:01:48.996Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T06:02:18.406" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:48.807" pid=910 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2355gitlab # [ 438.189177] gitaly[910]: time="2026-09-08T06:01:48.996Z" level=info msg="optimized repository" clean_stale_data_time=39.59376ms clean_work_trees_time="222.98µs" commit_graph_time="1.1µs" correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="2.76µs" pid=910 prune_time=480ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="2.48µs" storage_name=default system=housekeeping total_time=39.8976ms2356gitlab # [ 438.195029] gitaly[910]: time="2026-09-08T06:01:48.996Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T06:02:18.406" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:48.807" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2357gitlab # [ 438.204331] gitaly[910]: time="2026-09-08T06:01:49.062Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQG2FZT627P46CVQZHXM8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T06:01:59.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T06:01:49.050" grpc.time_ms=11.547 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2358gitlab # [ 438.228030] gitaly[910]: time="2026-09-08T06:01:49.085Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T06:02:19.084" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:49.084" grpc.time_ms=0.925 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2359gitlab # [ 438.271689] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4473f91e6d2f683dd5adcb9621434f2b014dabca HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2502360gitlab # [ 438.275500] nixbot[3554]: {"ts": "2026-09-08T06:01:49.131Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4473f91e6d2f683dd5adcb9621434f2b014dabca \"HTTP/1.1 201 Created\""}2361gitlab # [ 438.302003] gitaly[910]: time="2026-09-08T06:01:49.160Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQFCXB75YVZDHQA5GW60T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T06:02:19.158" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T06:01:49.158" grpc.time_ms=1.055 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2362gitlab # [ 438.326714] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.184Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"27043c696b892c975d48092f","created_at":"2026-09-08T06:01:49.180Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"774a1b0199e71c7426bf1998","job_size_bytes":3,"pid":3409,"job_status":"deduplicated","message":"PipelineProcessWorker JID-27043c696b892c975d48092f: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2363gitlab # [ 438.350120] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.188Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"774a1b0199e71c7426bf1998","created_at":"2026-09-08T06:01:48.500Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-59f42fa0e9b94526","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:48.508Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3409,"job_status":"rescheduled","message":"PipelineProcessWorker JID-774a1b0199e71c7426bf1998: rescheduled"}2364gitlab # [ 438.369443] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.204Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"774a1b0199e71c7426bf1998","created_at":"2026-09-08T06:01:48.500Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-59f42fa0e9b94526","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:48.508Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-774a1b0199e71c7426bf1998: done: 0.690025 sec","job_status":"done","queue_duration_s":0.006484,"scheduling_latency_s":0.006548,"gitaly_calls":3,"gitaly_duration_s":0.161202,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.027995,"redis_read_bytes":239,"redis_write_bytes":21786,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002237,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002175,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.006703,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14471,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.010341,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000528,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000694,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00308,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.168,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.022,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.026,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.132,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.347674,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.49722456,"duration_s":0.690025,"completed_at":"2026-09-08T06:01:49.204Z","load_balancing_strategy":"primary","db_duration_s":0.182536,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2365gitlab # [ 438.422140] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.207Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3d0639febd523a7e83fc51c3","created_at":"2026-09-08T06:01:48.788Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:48.793Z","job_size_bytes":23,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3d0639febd523a7e83fc51c3: start","job_status":"start","queue_duration_s":0.414162,"scheduling_latency_s":0.414194}2366gitlab # [ 438.438505] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.287Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3d0639febd523a7e83fc51c3","created_at":"2026-09-08T06:01:48.788Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:48.793Z","job_size_bytes":23,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3d0639febd523a7e83fc51c3: done: 0.080117 sec","job_status":"done","queue_duration_s":0.414162,"scheduling_latency_s":0.414194,"redis_calls":7,"redis_duration_s":0.0030600000000000002,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001922,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.080117,"completed_at":"2026-09-08T06:01:49.287Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016435,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2367gitlab # [ 438.481669] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.290Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"80fc239e130c5c53f037c389","created_at":"2026-09-08T06:01:48.965Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:48.973Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-80fc239e130c5c53f037c389: start","job_status":"start","queue_duration_s":0.317225,"scheduling_latency_s":0.317257}2368gitlab # [ 438.497852] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.337Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"80fc239e130c5c53f037c389","created_at":"2026-09-08T06:01:48.965Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:48.973Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-80fc239e130c5c53f037c389: done: 0.047838 sec","job_status":"done","queue_duration_s":0.317225,"scheduling_latency_s":0.317257,"redis_calls":7,"redis_duration_s":0.0023049999999999998,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000634,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047838,"completed_at":"2026-09-08T06:01:49.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2369gitlab # [ 438.540223] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.340Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fd8ee7033cc43d08d34531f7","created_at":"2026-09-08T06:01:48.992Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.000Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fd8ee7033cc43d08d34531f7: start","job_status":"start","queue_duration_s":0.339415,"scheduling_latency_s":0.33944}2370gitlab # [ 438.555784] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.405Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fd8ee7033cc43d08d34531f7","created_at":"2026-09-08T06:01:48.992Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.000Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fd8ee7033cc43d08d34531f7: done: 0.065597 sec","job_status":"done","queue_duration_s":0.339415,"scheduling_latency_s":0.33944,"redis_calls":7,"redis_duration_s":0.00209,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001498,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000592,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.065597,"completed_at":"2026-09-08T06:01:49.405Z","load_balancing_strategy":"primary","db_duration_s":0.015741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2371gitlab # [ 438.597486] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.408Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"564ddfde248c18a9173e9b91","created_at":"2026-09-08T06:01:49.020Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.024Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-564ddfde248c18a9173e9b91: start","job_status":"start","queue_duration_s":0.383974,"scheduling_latency_s":0.383998}2372gitlab # [ 438.612827] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.453Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"564ddfde248c18a9173e9b91","created_at":"2026-09-08T06:01:49.020Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.024Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-564ddfde248c18a9173e9b91: done: 0.045212 sec","job_status":"done","queue_duration_s":0.383974,"scheduling_latency_s":0.383998,"redis_calls":10,"redis_duration_s":0.004849,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.0032,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000435,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045212,"completed_at":"2026-09-08T06:01:49.453Z","load_balancing_strategy":"primary","db_duration_s":0.007441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2373gitlab # [ 438.655593] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.455Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c14d208bd939898147bcbc07","created_at":"2026-09-08T06:01:49.026Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.030Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c14d208bd939898147bcbc07: start","job_status":"start","queue_duration_s":0.425318,"scheduling_latency_s":0.425342}2374gitlab # [ 438.672496] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c14d208bd939898147bcbc07","created_at":"2026-09-08T06:01:49.026Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.030Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c14d208bd939898147bcbc07: done: 0.034213 sec","job_status":"done","queue_duration_s":0.425318,"scheduling_latency_s":0.425342,"redis_calls":7,"redis_duration_s":0.001719,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001305,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034213,"completed_at":"2026-09-08T06:01:49.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2375gitlab # [ 438.715762] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.492Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"798306f9aa9aa173890fc037","created_at":"2026-09-08T06:01:49.031Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.036Z","job_size_bytes":19,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-798306f9aa9aa173890fc037: start","job_status":"start","queue_duration_s":0.455935,"scheduling_latency_s":0.455956}2376gitlab # [ 438.731826] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.524Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"798306f9aa9aa173890fc037","created_at":"2026-09-08T06:01:49.031Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.036Z","job_size_bytes":19,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-798306f9aa9aa173890fc037: done: 0.03254 sec","job_status":"done","queue_duration_s":0.455935,"scheduling_latency_s":0.455956,"redis_calls":8,"redis_duration_s":0.0037589999999999998,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003289,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00047,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03254,"completed_at":"2026-09-08T06:01:49.524Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2377gitlab # [ 438.773593] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.526Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"995d54d3089f2b34bb459c18","created_at":"2026-09-08T06:01:49.038Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.041Z","job_size_bytes":66,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-995d54d3089f2b34bb459c18: start","job_status":"start","queue_duration_s":0.485365,"scheduling_latency_s":0.485385}2378gitlab # [ 438.790973] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 802379gitlab # [ 438.793355] gitaly[910]: time="2026-09-08T06:01:49.572Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQGNM777SCZDP4ZH3YH43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:49.561" grpc.time_ms=10.824 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2380gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses2381gitlab # [ 438.806096] gitaly[910]: time="2026-09-08T06:01:49.649Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQGR61HDVBMA7EA0R9H07 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:49.631" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2382gitlab # [ 438.816114] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.555Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"995d54d3089f2b34bb459c18","created_at":"2026-09-08T06:01:49.038Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.041Z","job_size_bytes":66,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-995d54d3089f2b34bb459c18: done: 0.029086 sec","job_status":"done","queue_duration_s":0.485365,"scheduling_latency_s":0.485385,"redis_calls":7,"redis_duration_s":0.001797,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001295,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000502,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029086,"completed_at":"2026-09-08T06:01:49.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2383gitlab # [ 438.857670] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.557Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"3586993000f7ba5ad81c6a8c","created_at":"2026-09-08T06:01:49.042Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.045Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3586993000f7ba5ad81c6a8c: start","job_status":"start","queue_duration_s":0.512116,"scheduling_latency_s":0.512136}2384gitlab # [ 438.873845] gitlab-workhorse[815]: time="2026-09-08T06:01:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672385gitlab # [ 438.876231] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 762386gitlab # [ 438.879389] gitaly[910]: time="2026-09-08T06:01:49.649Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQGR61HDVBMA7EA0R9H07 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:49.631" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2387gitlab # [ 438.893094] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.633Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"3586993000f7ba5ad81c6a8c","created_at":"2026-09-08T06:01:49.042Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.045Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3586993000f7ba5ad81c6a8c: done: 0.075882 sec","job_status":"done","queue_duration_s":0.512116,"scheduling_latency_s":0.512136,"redis_calls":7,"redis_duration_s":0.004316,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002055,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.075882,"completed_at":"2026-09-08T06:01:49.633Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008099,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2388gitlab # [ 438.935455] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.636Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"fe2a986f7085a8401e122671","created_at":"2026-09-08T06:01:49.052Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.056Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-fe2a986f7085a8401e122671: start","job_status":"start","queue_duration_s":0.580574,"scheduling_latency_s":0.580606}2389gitlab # [ 438.952182] gitaly[910]: time="2026-09-08T06:01:49.650Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSQGR61HDVBMA7EA0R9H07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:49.631" grpc.time_ms=18.299 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2390gitlab # [ 438.966657] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 662391gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses, in 0.19 seconds)2392(finished: subtest: eval and build post commit statuses, in 11.31 seconds)2393(finished: run the VM test script, in 512.72 seconds)2394gitlab # [ 438.968727] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.693Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"fe2a986f7085a8401e122671","created_at":"2026-09-08T06:01:49.052Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.056Z","job_size_bytes":3,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-fe2a986f7085a8401e122671: done: 0.057156 sec","job_status":"done","queue_duration_s":0.580574,"scheduling_latency_s":0.580606,"redis_calls":7,"redis_duration_s":0.003085,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.057156,"completed_at":"2026-09-08T06:01:49.693Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015278,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2395gitlab # [ 439.012404] sidekiq-cluster[3409]: {"severity":"INFO","time":"2026-09-08T06:01:49.696Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ac28c21410be18097f82603f","created_at":"2026-09-08T06:01:49.056Z","trace_propagation_headers":{"sentry-trace":"19e6a7e271844d8685944d426d097cad-a22d70dcd93141dd","baggage":"sentry-trace_id=19e6a7e271844d8685944d426d097cad,sentry-release=Unknown"},"correlation_id":"01M1ZSQFCXB75YVZDHQA5GW60T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T06:01:49.060Z","job_size_bytes":6,"pid":3409,"sidekiq_tid":"m8mx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ac28c21410be18097f82603f: start","job_status":"start","queue_duration_s":0.635964,"scheduling_latency_s":0.635997}2396gitlab # [ 439.031946] gitaly[910]: time="2026-09-08T06:01:49.783Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSQGWNAX2G8WRR5TMW12NM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T06:01:49.768" grpc.time_ms=14.878 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2397test script finished in 512.75s2398cleanup2399gitlab # [ 439.045696] gitlab-workhorse[815]: gitlab 2001:db8:1::1 - - [2026/09/08:06:01:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4473f91e6d2f683dd5adcb9621434f2b014dabca/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 1162400kill QemuMachine (pid 46)2401gitlab # [ 439.048147] gitlab-workhorse[815]: time="2026-09-08T06:01:49Z" level=info msg=git_traffic project_id=1 root_namqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2402gitlab # e2403(finished: cleanup, in 1.52 seconds)2404additionally exposed symbols:2405 gitlab,2406 vlan1,2407 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2408[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-08T06:00:11.348Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2409[]2410[]2411[]2412[]2413[]2414[]2415[]2416[]2417[]2418[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-08T06:01:38.229177Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]2419[{'id': 5, 'sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T06:01:38.655Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2420[{'id': 5, 'sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T06:01:38.655Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2421[{'id': 5, 'sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T06:01:38.655Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2422[{'id': 5, 'sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T06:01:38.655Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2423[{'id': 5, 'sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T06:01:38.655Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2424[{'id': 5, 'sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T06:01:38.655Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2425[{'id': 5, 'sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T06:01:38.655Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2426[{'id': 5, 'sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T06:01:38.655Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2427[{'id': 5, 'sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-08T06:01:38.655Z', 'started_at': None, 'finished_at': '2026-09-08T06:01:48.479Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2428[{'id': 5, 'sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-08T06:01:38.655Z', 'started_at': None, 'finished_at': '2026-09-08T06:01:48.479Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '4473f91e6d2f683dd5adcb9621434f2b014dabca', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-09-08T06:01:48.818Z', 'started_at': None, 'finished_at': '2026-09-08T06:01:49.094Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]