vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #245
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.vafZMkrWwJ', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 75.19 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 5fa85a94-9d9d-4fdb-a016-b94b3882273f19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nsc0n24i32a3x9a6f4mbrx2gf4jn0alr-nixos-system-gitlab-test/init regInfo=/nix/store/dxygd5ipryn11ahz8jwcy4bxv4j3z7bf-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/dxygd5ipryn11ahz8jwcy4bxv4j3z7bf-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000031] arm-pv: using stolen time PV108gitlab # [ 0.000381] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000596] Console: colour dummy device 80x25110gitlab # [ 0.000603] printk: legacy console [tty0] enabled111gitlab # [ 0.000783] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000790] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000871] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000996] landlock: Up and running.115gitlab # [ 0.000999] Yama: becoming mindful.116gitlab # [ 0.001429] LSM support for eBPF active117gitlab # [ 0.001666] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001779] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.003021] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003713] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003718] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003871] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004889] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004984] EFI services will not be available.125gitlab # [ 0.005190] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005847] Detected PIPT I-cache on CPU1127gitlab # [ 0.005943] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.006066] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006185] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007265] Detected PIPT I-cache on CPU2131gitlab # [ 0.007369] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007490] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007613] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008651] Detected PIPT I-cache on CPU3135gitlab # [ 0.008770] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008892] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.009017] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009530] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009556] SMP: Total of 4 processors activated.140gitlab # [ 0.009558] CPU: All CPU(s) started at EL1141gitlab # [ 0.009567] CPU features: detected: Branch Target Identification142gitlab # [ 0.009571] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009574] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009577] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009581] CPU features: detected: Common not Private translations146gitlab # [ 0.009583] CPU features: detected: CRC32 instructions147gitlab # [ 0.009586] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009589] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009592] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009595] CPU features: detected: E0PD151gitlab # [ 0.009597] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009600] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009603] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009605] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009608] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009612] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009615] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009617] CPU features: detected: Privileged Access Never159gitlab # [ 0.009619] CPU features: detected: PMUv3160gitlab # [ 0.009622] CPU features: detected: RAS Extension Support161gitlab # [ 0.009624] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009627] CPU features: detected: Random Number Generator163gitlab # [ 0.009629] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009631] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009634] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009637] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009768] alternatives: applying system-wide alternatives168gitlab # [ 0.012735] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012976] Memory: 5963776K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014496] devtmpfs: initialized171gitlab # [ 0.018586] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018659] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018863] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018868] 0 pages in range for non-PLT usage175gitlab # [ 0.018869] 508288 pages in range for PLT usage176gitlab # [ 0.018999] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019845] DMI not present or invalid.178gitlab # [ 0.023220] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.025562] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025837] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.027558] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.027580] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027901] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.028348] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.028351] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.028356] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.028358] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.028361] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.028442] cpuidle: using governor ladder190gitlab # [ 0.028507] cpuidle: using governor menu191gitlab # [ 0.028701] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028910] ASID allocator initialised with 65536 entries193gitlab # [ 0.030003] Serial: AMBA PL011 UART driver194gitlab # [ 0.035221] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.035556] printk: console [ttyAMA0] enabled196gitlab # [ 0.047350] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.047372] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.047382] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.047390] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.047398] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.047406] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.047414] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.047422] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.059415] fbcon: Taking over console205gitlab # [ 0.059428] ACPI: Interpreter disabled.206gitlab # [ 0.060450] iommu: Default domain type: Translated207gitlab # [ 0.060466] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.070430] SCSI subsystem initialized209gitlab # [ 0.071440] usbcore: registered new interface driver usbfs210gitlab # [ 0.071468] usbcore: registered new interface driver hub211gitlab # [ 0.071490] usbcore: registered new device driver usb212gitlab # [ 0.071795] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.071799] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.071808] PTP clock support registered215gitlab # [ 0.071847] EDAC MC: Ver: 3.0.0216gitlab # [ 0.072473] scmi_core: SCMI protocol bus registered217gitlab # [ 0.073442] FPGA manager framework218gitlab # [ 0.074197] vgaarb: loaded219gitlab # [ 0.075324] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.075831] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.075858] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.077516] netfs: FS-Cache loaded223gitlab # [ 0.077626] pnp: PnP ACPI: disabled224gitlab # [ 0.086802] NET: Registered PF_INET protocol family225gitlab # [ 0.087730] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.116546] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.116603] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.116662] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.116996] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.117558] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.117683] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.117747] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.117867] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.118046] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.118068] NET: Registered PF_XDP protocol family236gitlab # [ 0.118085] PCI: CLS 0 bytes, default 64237gitlab # [ 0.118378] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.128193] kvm [1]: HYP mode not available239gitlab # [ 0.221298] Initialise system trusted keyrings240gitlab # [ 0.221709] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.222773] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.222921] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.238956] Key type asymmetric registered244gitlab # [ 0.238962] Asymmetric key parser 'x509' registered245gitlab # [ 0.239106] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.239542] io scheduler mq-deadline registered247gitlab # [ 0.239572] io scheduler kyber registered248gitlab # [ 0.255367] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.259501] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.260411] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.260442] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.260480] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.260494] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.260533] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.260579] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.260851] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.260867] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.260893] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.260903] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.260910] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.261156] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.262330] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.262842] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.262873] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.262937] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.262967] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.264203] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.264691] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.264721] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.264795] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.266012] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.266481] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.266511] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.266590] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.267850] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.268318] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.268348] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.268421] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.269614] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.270100] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.270129] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.270208] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.271514] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.272008] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.272038] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.272111] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.273318] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.273784] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.273813] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.273890] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.273920] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.275196] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.275739] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.275803] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.277059] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.277550] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.277614] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.278653] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.279132] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.279786] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.280402] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.280431] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.280494] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.281704] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.282177] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.282216] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.282279] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.283776] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.283791] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.283800] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.283914] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.284036] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.284154] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.284266] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.284378] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.284481] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.284584] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.284702] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.284819] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.284979] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.285085] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.285128] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.285170] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.285213] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.285256] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.285300] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.285343] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.285388] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.285432] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.285478] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.285532] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.285577] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.285620] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.285662] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.285705] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.285747] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.285790] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.285832] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.285874] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.285918] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.285962] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.286014] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.286027] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.286034] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.289304] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.323684] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.329436] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.335634] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.342275] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.348403] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.355011] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.361255] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.368373] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.374272] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.380600] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.387503] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.402275] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.406615] msm_serial: driver initialized359gitlab # [ 0.407016] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.407141] STM32 USART driver initialized361gitlab # [ 0.449881] loop: module loaded362gitlab # [ 0.450322] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.454170] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.458116] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.462027] virtio_blk virtio5: [vdb] 12204272 512-byte logical blocks (6.25 GB/5.82 GiB)366gitlab # [ 0.466155] megasas: 07.734.00.00-rc1367gitlab # [ 0.467550] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.473038] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.473069] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.476189] Using buffer write method371gitlab # [ 0.476245] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.480435] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.480460] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.483035] Using buffer write method375gitlab # [ 0.483059] Concatenating MTD devices:376gitlab # [ 0.483063] (0): "0.flash"377gitlab # [ 0.483068] (1): "0.flash"378gitlab # [ 0.483072] into device "0.flash"379gitlab # [ 0.590522] Freeing initrd memory: 27184K380gitlab # [ 0.606376] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.614872] thunder_xcv, ver 1.0382gitlab # [ 0.614989] thunder_bgx, ver 1.0383gitlab # [ 0.615054] nicpf, ver 1.0384gitlab # [ 0.616836] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.616849] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.616945] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.616959] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.617034] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.617043] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.617111] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.617120] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.617538] sky2: driver version 1.30393gitlab # [ 0.622176] ehci-pci 0000:00:0a.0: EHCI Host Controller394gitlab # [ 0.622231] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1395gitlab # [ 0.622569] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000396gitlab # [ 0.622639] usbcore: registered new interface driver usb-storage397gitlab # [ 0.622858] usbcore: registered new interface driver usbserial_generic398gitlab # [ 0.622898] usbserial: USB Serial support registered for generic399gitlab # [ 0.624803] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.627387] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.627487] rtc-pl031 9010000.pl031: setting system clock to 2026-08-20T05:52:58 UTC (1787205178)402gitlab # [ 0.628448] i2c_dev: i2c /dev entries driver403gitlab # [ 0.631385] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.632446] hub 1-0:1.0: USB hub found405gitlab # [ 0.632478] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.636915] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.636931] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.637748] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.638964] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.643809] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.644827] usbcore: registered new interface driver usbhid412gitlab # [ 0.644838] usbhid: USB HID core driver413gitlab # [ 0.653851] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.658246] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.658547] NET: Registered PF_INET6 protocol family416gitlab # [ 0.660625] Segment Routing with IPv6417gitlab # [ 0.660689] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.660755] NET: Registered PF_PACKET protocol family419gitlab # [ 0.661083] 9pnet: Installing 9P2000 support420gitlab # [ 0.665298] Key type dns_resolver registered421gitlab # [ 0.682481] registered taskstats version 1422gitlab # [ 0.683061] Loading compiled-in X.509 certificates423gitlab # [ 0.704731] Demotion targets for Node 0: null424gitlab # [ 0.704931] Key type .fscrypt registered425gitlab # [ 0.704938] Key type fscrypt-provisioning registered426gitlab # [ 0.705173] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.705195] ima: Allocated hash algorithm: sha1428gitlab # [ 0.705226] ima: No architecture policies found429gitlab # [ 0.706535] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.731905] clk: Disabling unused clocks431gitlab # [ 0.731936] PM: genpd: Disabling unused power domains432gitlab # [ 0.736516] Freeing unused kernel memory: 4736K433gitlab # [ 0.736720] Run /init as init process434gitlab # [ 0.762306] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.879403] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.038570] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.096649] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.096716] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.096790] systemd[1]: Detected architecture arm64.440gitlab # [ 1.096809] systemd[1]: Running in initrd.441gitlab # [ 1.097676] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.097941] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.187809] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.307434] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.392935] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.463648] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.464212] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.507196] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.527937] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.528343] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.528401] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.528424] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.528465] systemd[1]: Reached target Path Units.454gitlab # [ 1.528491] systemd[1]: Reached target Slice Units.455gitlab # [ 1.528521] systemd[1]: Reached target Swaps.456gitlab # [ 1.528552] systemd[1]: Reached target Timer Units.457gitlab # [ 1.528827] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.529114] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.529437] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.529686] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.529839] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.529874] systemd[1]: Reached target Socket Units.463gitlab # [ 1.532603] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.535453] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.535567] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.538374] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.564930] systemd[1]: Starting Journal Service...468gitlab # [ 1.567831] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.567974] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.575540] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.577656] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.579282] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.581057] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.591638] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...475gitlab # [ 1.593051] systemd[1]: Mounted Kernel Configuration File System.476gitlab # [ 1.609391] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0477gitlab # [ 1.609598] [drm] features: -virgl +edid -resource_blob -host_visible478gitlab # [ 1.609602] [drm] features: -context_init479gitlab # [ 1.615421] [drm] number of scanouts: 1480gitlab # [ 1.615495] [drm] number of cap sets: 0481gitlab # [ 1.616752] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.482gitlab # [ 1.617106] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev483gitlab # [ 1.619865] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic484gitlab # [ 1.619877] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0485gitlab # [ 1.620630] systemd-journald[95]: Collecting audit messages is disabled.486gitlab # [ 1.631815] Console: switching to colour frame buffer device 160x50487gitlab # [ 1.638275] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device488gitlab # [ 1.648022] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.489gitlab # [ 1.651947] systemd[1]: Starting Create Static Device Nodes in /dev...490gitlab # [ 1.672013] systemd[1]: Finished Load Kernel Modules.491gitlab # [ 1.679608] systemd[1]: Starting Apply Kernel Variables...492gitlab # [ 1.694861] systemd[1]: Finished Create Static Device Nodes in /dev.493gitlab # [ 1.695170] systemd[1]: Reached target Preparation for Local File Systems.494gitlab # [ 1.695228] systemd[1]: Reached target Local File Systems.495gitlab # [ 1.703037] systemd[1]: Starting Rule-based Manager for Device Events and Files...496gitlab # [ 1.703577] systemd[1]: Started Journal Service.497gitlab # [ 1.700160] systemd-modules-load[96]: Using 4 probe threads498gitlab # [ 1.708519] systemd-modules-load[96]: Module 'virtio_balloon' is built in499gitlab # [ 1.710142] systemd-modules-load[96]: Module 'virtio_console' is built in500gitlab # [ 1.711350] systemd-modules-load[96]: Module 'virtio_rng' is built in501gitlab # [ 1.712486] systemd-modules-load[96]: Inserted module 'dm_mod'502gitlab # [ 1.713926] systemd-modules-load[96]: Inserted module 'virtio_gpu'503gitlab # [ 1.714985] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.740952] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.765088] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.778411] systemd-udevd[107]: Using default interface naming scheme 'v261'.507gitlab # [ 1.797712] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.824640] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.878767] systemd-vconsole-setup[129]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.883995] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.280482] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.281988] systemd[1]: Reached target System Initialization.513gitlab # [ 2.282828] systemd[1]: Reached target Basic System.514gitlab # [ 2.464828] (udev-worker)[146]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.485263] (udev-worker)[135]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 2.489196] (udev-worker)[135]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.501975] systemd[1]: Found device /dev/disk/by-label/nix-store.518gitlab # [ 2.524123] systemd[1]: Found device /dev/disk/by-label/nixos.519gitlab # [ 2.525372] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.527329] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.576064] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.581468] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.583803] systemd[1]: Mounting /sysroot...524gitlab # [ 2.650043] EXT4-fs (vda): mounted filesystem 5fa85a94-9d9d-4fdb-a016-b94b3882273f r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.650507] systemd[1]: Mounted /sysroot.526gitlab # [ 2.651342] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.659127] systemd[1]: Starting Mountpoints Configured in the Real Root...528gitlab # [ 2.691315] systemd-sysroot-fstab-check[159]: /sysroot should be mounted in the initrd, will request daemon-reload.529gitlab # [ 2.694596] systemd[1]: Reload requested from client PID 159 ('systemd-sysroot') (unit initrd-parse-etc.service)...530gitlab # [ 2.696708] systemd[1]: Reloading...531gitlab # [ 2.820667] systemd[1]: Reloading finished in 125 ms.532gitlab # [ 2.866644] systemd-sysroot-fstab-check[159]: Requesting initrd-fs.target/start/replace...533gitlab # [ 2.869622] systemd-sysroot-fstab-check[159]: Requesting swap.target/start/replace...534gitlab # [ 2.872552] systemd[1]: Starting Load Kernel Module 9pnet_virtio...535gitlab # [ 2.874153] systemd[1]: initrd-parse-etc.service: Deactivated successfully.536gitlab # [ 2.875334] systemd[1]: Finished Mountpoints Configured in the Real Root.537gitlab # [ 2.876538] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.538gitlab # [ 2.896722] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.539gitlab # [ 2.897808] systemd[1]: Finished Load Kernel Module 9pnet_virtio.540gitlab # [ 3.035675] (udev-worker)[134]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory541gitlab # [ 3.039079] (udev-worker)[134]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory542gitlab # [ 3.050072] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.543gitlab # [ 3.051210] systemd[1]: Stopped Virtual Console Setup.544gitlab # [ 3.051968] systemd[1]: Stopping Virtual Console Setup...545gitlab # [ 3.052821] systemd[1]: Starting Virtual Console Setup...546gitlab # [ 3.085940] systemd-vconsole-setup[182]: Configuration of first virtual console was skipped, ignoring remaining ones.547gitlab # [ 3.088373] systemd[1]: Finished Virtual Console Setup.548gitlab # [ 3.580951] systemd[1]: Mounting /sysroot/nix/.ro-store...549gitlab # [ 3.584572] systemd[1]: Mounting /sysroot/nix/.rw-store...550gitlab # [ 3.591499] systemd[1]: Mounting /sysroot/run...551gitlab # [ 3.595334] systemd[1]: Mounting /sysroot/tmp/shared...552gitlab # [ 3.616352] systemd[1]: Mounting /sysroot/tmp/xchg...553gitlab # [ 3.636295] systemd[1]: Mounted /sysroot/nix/.rw-store.554gitlab # [ 3.642089] systemd[1]: Mounted /sysroot/run.555gitlab # [ 3.653368] systemd[1]: Starting rw-sysroot-nix-store.service...556gitlab # [ 3.662400] erofs (device vdb): mounted with root inode @ nid 128.557gitlab # [ 3.659771] systemd[1]: Mounted /sysroot/tmp/shared.558gitlab # [ 3.670410] systemd[1]: Mounted /sysroot/nix/.ro-store.559gitlab # [ 3.673684] systemd[1]: Mounted /sysroot/tmp/xchg.560gitlab # [ 3.675829] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.561gitlab # [ 3.680419] systemd[1]: Finished rw-sysroot-nix-store.service.562gitlab # [ 4.578627] systemd[1]: Mounting /sysroot/nix/store...563gitlab # [ 4.651470] systemd[1]: Mounted /sysroot/nix/store.564gitlab # [ 4.654732] systemd[1]: Reached target Initrd File Systems.565gitlab # [ 4.657511] systemd[1]: Starting Find NixOS closure...566gitlab # [ 4.660102] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...567gitlab # [ 4.712524] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.568gitlab # [ 4.716146] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.569gitlab # [ 4.733331] systemd[1]: Finished Find NixOS closure.570gitlab # [ 4.735692] systemd[1]: Reached target Initrd Default Target.571gitlab # [ 4.738342] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...572gitlab # [ 4.792813] systemd[1]: Stopped target Initrd Default Target.573gitlab # [ 4.795349] systemd[1]: Stopped target Basic System.574gitlab # [ 4.797698] systemd[1]: Stopped target Initrd Root Device.575gitlab # [ 4.800109] systemd[1]: Stopped target Path Units.576gitlab # [ 4.802229] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.577gitlab # [ 4.805549] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.578gitlab # [ 4.809038] systemd[1]: Stopped target Slice Units.579gitlab # [ 4.811193] systemd[1]: Stopped target Socket Units.580gitlab # [ 4.813496] systemd[1]: Stopped target System Initialization.581gitlab # [ 4.818916] systemd[1]: Stopped target Swaps.582gitlab # [ 4.820951] systemd[1]: Stopped target Timer Units.583gitlab # [ 4.823083] systemd[1]: dbus.socket: Deactivated successfully.584gitlab # [ 4.830513] systemd[1]: Closed D-Bus System Message Bus Socket.585gitlab # [ 4.834342] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.586gitlab # [ 4.837962] systemd[1]: Stopped Find NixOS closure.587gitlab # [ 4.840544] systemd[1]: Starting Load Kernel Module 9pnet_virtio...588gitlab # [ 4.842799] systemd[1]: Starting rw-sysroot-nix-store.service...589gitlab # [ 4.845187] systemd[1]: systemd-sysctl.service: Deactivated successfully.590gitlab # [ 4.847375] systemd[1]: Stopped Apply Kernel Variables.591gitlab # [ 4.849368] systemd[1]: systemd-modules-load.service: Deactivated successfully.592gitlab # [ 4.851651] systemd[1]: Stopped Load Kernel Modules.593gitlab # [ 4.853280] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.594gitlab # [ 4.855643] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.595gitlab # [ 4.857942] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.596gitlab # [ 4.860052] systemd[1]: Stopped Create System Files and Directories.597gitlab # [ 4.861837] systemd[1]: Stopped target Local File Systems.598gitlab # [ 4.863380] systemd[1]: Stopped target Preparation for Local File Systems.599gitlab # [ 4.865151] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.600gitlab # [ 4.866941] systemd[1]: Stopped Coldplug All udev Devices.601gitlab # [ 4.868304] systemd[1]: Stopping Rule-based Manager for Device Events and Files...602gitlab # [ 4.870043] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.603gitlab # [ 4.871735] systemd[1]: Stopped Virtual Console Setup.604gitlab # [ 4.873014] systemd[1]: initrd-cleanup.service: Deactivated successfully.605gitlab # [ 4.874679] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.606gitlab # [ 4.876107] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.607gitlab # [ 4.877650] systemd[1]: Finished Load Kernel Module 9pnet_virtio.608gitlab # [ 4.878959] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 4.880543] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 4.881808] systemd[1]: systemd-udevd.service: Deactivated successfully.611gitlab # [ 4.883233] systemd[1]: Stopped Rule-based Manager for Device Events and Files.612gitlab # [ 4.884824] systemd[1]: systemd-udevd.service: Consumed 2.195s CPU time over 3.163s wall clock time, 31.4M memory peak.613gitlab # [ 4.886993] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.614gitlab # [ 4.888590] systemd[1]: Closed udev Control Socket.615gitlab # [ 4.889713] systemd[1]: Starting Cleanup udev Database...616gitlab # [ 4.891122] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.617gitlab # [ 4.892845] systemd[1]: Stopped Create Static Device Nodes in /dev.618gitlab # [ 4.894199] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.619gitlab # [ 4.895929] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.620gitlab # [ 4.897550] systemd[1]: kmod-static-nodes.service: Deactivated successfully.621gitlab # [ 4.899042] systemd[1]: Stopped Create List of Static Device Nodes.622gitlab # [ 4.966835] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.623gitlab # [ 4.970196] systemd[1]: Finished Cleanup udev Database.624gitlab # [ 4.972526] systemd[1]: Reached target Switch Root.625gitlab # [ 4.974645] systemd[1]: Starting NixOS Activation...626gitlab # [ 5.176992] initrd-nixos-activation-start[221]: booting system configuration /nix/store/nsc0n24i32a3x9a6f4mbrx2gf4jn0alr-nixos-system-gitlab-test627gitlab # [ 5.240609] initrd-nixos-activation-start[221]: running activation script...628gitlab # [ 5.581157] initrd-nixos-activation-start[244]: setting up /etc...629gitlab # [ 5.746427] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.630gitlab # [ 5.749892] systemd[1]: Finished NixOS Activation.631gitlab # [ 5.752088] systemd[1]: Starting Switch Root...632gitlab # [ 5.807091] systemd[1]: Switching root.633gitlab # [ 5.928597] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).634gitlab # [ 6.594014] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)635gitlab # [ 6.594281] systemd[1]: Detected virtualization qemu.636gitlab # [ 6.594387] systemd[1]: Detected architecture arm64.637gitlab # [ 6.594633] systemd[1]: Detected first boot.638gitlab # [ 6.596619] systemd[1]: Initializing machine ID from random generator.639gitlab # [ 6.844423] systemd[1]: bpf-restrict-fs: LSM BPF program attached640gitlab # [ 6.977807] systemd[1]: Applying preset policy.641gitlab # [ 7.202748] systemd[1]: Populated /etc with preset unit settings.642gitlab # [ 7.371455] systemd[1]: initrd-switch-root.service: Deactivated successfully.643gitlab # [ 7.371729] systemd[1]: Stopped initrd-switch-root.service.644gitlab # [ 7.373854] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.645gitlab # [ 7.380807] systemd[1]: Created slice Slice /system/getty.646gitlab # [ 7.384165] systemd[1]: Created slice GitLab DevOps Platform Slice.647gitlab # [ 7.388165] systemd[1]: Created slice User and Session Slice.648gitlab # [ 7.388765] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.649gitlab # [ 7.389639] systemd[1]: Started Forward Password Requests to Wall Directory Watch.650gitlab # [ 7.390459] systemd[1]: Expecting device /dev/hvc0...651gitlab # [ 7.391298] systemd[1]: Expecting device /dev/ttyAMA0...652gitlab # [ 7.392198] systemd[1]: Reached target Local Encrypted Volumes.653gitlab # [ 7.393055] systemd[1]: Stopped target initrd-fs.target.654gitlab # [ 7.393864] systemd[1]: Stopped target initrd-root-fs.target.655gitlab # [ 7.394641] systemd[1]: Stopped target initrd-switch-root.target.656gitlab # [ 7.395406] systemd[1]: Reached target Virtual Machines and Containers.657gitlab # [ 7.396150] systemd[1]: Reached target Path Units.658gitlab # [ 7.396868] systemd[1]: Reached target Remote File Systems.659gitlab # [ 7.397604] systemd[1]: Reached target Slice Units.660gitlab # [ 7.398369] systemd[1]: Reached target Swaps.661gitlab # [ 7.400258] systemd[1]: Listening on Query the User Interactively for a Password.662gitlab # [ 7.401912] systemd[1]: Listening on Process Core Dump Socket.663gitlab # [ 7.403136] systemd[1]: Listening on Credential Encryption/Decryption.664gitlab # [ 7.404454] systemd[1]: Listening on Factory Reset Management.665gitlab # [ 7.404941] systemd[1]: Listening on Hostname Service Socket.666gitlab # [ 7.411087] systemd[1]: Starting Journal Log Access Socket...667gitlab # [ 7.412529] systemd[1]: Listening on Journal Audit Socket.668gitlab # [ 7.416979] systemd[1]: Listening on Console Output Muting Service Socket.669gitlab # [ 7.418584] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.670gitlab # [ 7.419773] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os671gitlab # [ 7.420788] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki672gitlab # [ 7.427046] systemd[1]: Listening on Disk Repartitioning Service Socket.673gitlab # [ 7.428473] systemd[1]: Listening on udev Control Socket.674gitlab # [ 7.429842] systemd[1]: Listening on udev Varlink Socket.675gitlab # [ 7.438468] systemd[1]: Mounting Huge Pages File System...676gitlab # [ 7.447043] systemd[1]: Mounting POSIX Message Queue File System...677gitlab # [ 7.458206] systemd[1]: Mounting Kernel Debug File System...678gitlab # [ 7.466985] systemd[1]: Mounting Kernel Trace File System...679gitlab # [ 7.483669] systemd[1]: Starting Create List of Static Device Nodes...680gitlab # [ 7.495774] systemd[1]: Starting Load Kernel Module 9pnet_virtio...681gitlab # [ 7.496819] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs682gitlab # [ 7.507391] systemd[1]: Mounting Kernel Configuration File System...683gitlab # [ 7.508633] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm684gitlab # [ 7.509737] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore685gitlab # [ 7.521253] systemd[1]: Starting Load Kernel Module fuse...686gitlab # [ 7.522492] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67687gitlab # [ 7.533653] systemd[1]: Starting Journal Service...688gitlab # [ 7.539180] systemd[1]: Starting Load Kernel Modules...689gitlab # [ 7.551654] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...690gitlab # [ 7.561554] systemd[1]: Starting Remount Root and Kernel File Systems...691gitlab # [ 7.562628] systemd-journald[316]: Collecting audit messages is enabled.692gitlab # [ 7.564176] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os693gitlab # [ 7.576274] fuse: init (API version 7.45)694gitlab # [ 7.584328] systemd[1]: Queued start job for default target Multi-User System.695gitlab # [ 7.585803] systemd[1]: Unnecessary job was removed for /dev/vdb.696gitlab # [ 7.587031] systemd[1]: systemd-journald.service: Deactivated successfully.697gitlab # [ 7.588628] systemd-modules-load[317]: Using 3 probe threads[ 7.591631] systemd[1]: Starting Coldplug All udev Devices...698gitlab # 699gitlab # [ 7.592227] systemd-modules-load[317]: Module 'atkbd' is built in700gitlab # [ 7.595756] systemd-modules-load[317]: Module 'loop' is built in701gitlab # [ 7.597062] systemd-modules-load[317]: Inserted module 'tls'702gitlab # [ 7.602192] systemd[1]: Started Journal Service.703gitlab # [ 7.602324] systemd[1]: Listening on Journal Log Access Socket.704gitlab # [ 7.605438] systemd[1]: Mounted Huge Pages File System.705gitlab # [ 7.607145] systemd[1]: Mounted POSIX Message Queue File System.706gitlab # [ 7.608742] systemd[1]: Mounted Kernel Debug File System.707gitlab # [ 7.610057] systemd[1]: Mounted Kernel Trace File System.708gitlab # [ 7.611559] systemd[1]: Finished Create List of Static Device Nodes.709gitlab # [ 7.613189] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.710gitlab # [ 7.614940] systemd[1]: Finished Load Kernel Module 9pnet_virtio.711gitlab # [ 7.616516] systemd[1]: Mounted Kernel Configuration File System.712gitlab # [ 7.617983] systemd[1]: modprobe@fuse.service: Deactivated successfully.713gitlab # [ 7.619566] systemd[1]: Finished Load Kernel Module fuse.714gitlab # [ 7.620960] systemd[1]: Finished Load Kernel Modules.715gitlab # [ 7.624406] EXT4-fs (vda): re-mounted 5fa85a94-9d9d-4fdb-a016-b94b3882273f.716gitlab # [ 7.626960] systemd[1]: Mounting FUSE Control File System...717gitlab # [ 7.632638] systemd[1]: Starting Firewall...718gitlab # [ 7.644376] systemd-oomd[319]: No swap; memory pressure usage will be degraded719gitlab # [ 7.658157] systemd[1]: Starting Apply Kernel Variables...720gitlab # [ 7.664413] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...721gitlab # [ 7.671337] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.722gitlab # [ 7.675772] systemd[1]: Finished Remount Root and Kernel File Systems.723gitlab # [ 7.677072] systemd[1]: Mounted FUSE Control File System.724gitlab # [ 7.679869] systemd[1]: Listening on Disk Image Download Service Socket.725gitlab # [ 7.686217] systemd[1]: Starting Flush Journal to Persistent Storage...726gitlab # [ 7.690015] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore727gitlab # [ 7.696564] systemd[1]: Starting Load/Save OS Random Seed...728gitlab # [ 7.698228] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os729gitlab # [ 7.713570] systemd-journald[316]: Received client request to flush runtime journal.730gitlab # [ 7.743516] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.731gitlab # [ 7.744991] systemd[1]: Finished Apply Kernel Variables.732gitlab # [ 7.745941] systemd[1]: Starting Create Static Device Nodes in /dev...733gitlab # [ 7.746891] systemd[1]: Finished Load/Save OS Random Seed.734gitlab # [ 7.747666] systemd[1]: Reached target First Boot Complete.735gitlab # [ 7.748529] systemd[1]: Finished Create Static Device Nodes in /dev.736gitlab # [ 7.749428] systemd[1]: Finished Flush Journal to Persistent Storage.737gitlab # [ 7.750310] systemd[1]: Reached target Preparation for Local File Systems.738gitlab # [ 7.752281] systemd[1]: Starting Rule-based Manager for Device Events and Files...739gitlab # [ 7.834441] systemd-udevd[360]: Using default interface naming scheme 'v261'.740gitlab # [ 7.908421] systemd[1]: Started Rule-based Manager for Device Events and Files.741gitlab # [ 8.121326] systemd[1]: Finished Firewall.742gitlab # [ 8.232831] systemd[1]: Finished Coldplug All udev Devices.743gitlab # [ 8.319206] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs744gitlab # [ 8.388212] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.745gitlab # [ 8.394277] systemd[1]: Mounting /run/wrappers...746gitlab # [ 8.435950] systemd[1]: Mounted /run/wrappers.747gitlab # [ 8.440350] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.748gitlab # [ 8.442547] systemd[1]: Reached target Local File Systems.749gitlab # [ 8.448260] systemd[1]: Listening on Boot Loader Control Service Socket.750gitlab # [ 8.451696] systemd[1]: Starting register-nix-paths.service...751gitlab # [ 8.457123] systemd[1]: Starting Create SUID/SGID Wrappers...752gitlab # [ 8.458993] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.753gitlab # [ 8.474624] (udev-worker)[472]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.754gitlab # [ 8.478341] (udev-worker)[472]: Network interface NamePolicy= disabled on kernel command line.755gitlab # [ 8.490534] systemd[1]: Starting Save Transient machine-id to Disk...756gitlab # [ 8.499883] (udev-worker)[416]: Network interface NamePolicy= disabled on kernel command line.757gitlab # [ 8.504374] systemd[1]: Starting Create System Files and Directories...758gitlab # [ 8.517509] systemd[1]: Condition check resulted in Virtio network device being skipped.759gitlab # [ 8.518759] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore760gitlab # [ 8.520841] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.761gitlab # [ 8.524102] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67762gitlab # [ 8.529763] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore763gitlab # [ 8.532528] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os764gitlab # [ 8.534368] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os765gitlab # [ 8.549246] mousedev: PS/2 mouse device common for all mice766gitlab # [ 8.551842] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.767gitlab # [ 8.553532] systemd[1]: Finished Save Transient machine-id to Disk.768gitlab # [ 8.562725] systemd[1]: Finished Create System Files and Directories.769gitlab # [ 8.573538] systemd[1]: Starting Rebuild Journal Catalog...770gitlab # [ 8.576390] systemd[1]: Starting Record System Boot/Shutdown in UTMP...771gitlab # [ 8.604850] systemd[1]: Finished Record System Boot/Shutdown in UTMP.772gitlab # [ 8.621372] systemd[1]: Finished Rebuild Journal Catalog.773gitlab # [ 8.623708] systemd[1]: Starting Update is Completed...774gitlab # [ 8.638904] systemd[1]: Finished Update is Completed.775gitlab # [ 8.709198] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.776gitlab # [ 8.710568] systemd[1]: Finished Create SUID/SGID Wrappers.777gitlab # [ 8.712272] systemd[1]: suid-sgid-wrappers.service: Consumed 155ms CPU time over 252ms wall clock time, 6M memory peak, 1.9M read from disk.778gitlab # [ 9.072487] systemd[1]: Finished register-nix-paths.service.779gitlab # [ 9.074192] systemd[1]: Reached target System Initialization.780gitlab # [ 9.075295] systemd[1]: Started Discard unused filesystem blocks once a week.781gitlab # [ 9.076411] systemd[1]: Started logrotate.timer.782gitlab # [ 9.077158] systemd[1]: Started Daily Cleanup of Temporary Directories.783gitlab # [ 9.078152] systemd[1]: Reached target Timer Units.784gitlab # [ 9.081877] systemd[1]: Listening on D-Bus System Message Bus Socket.785gitlab # [ 9.082948] systemd[1]: Listening on Nix Daemon Socket.786gitlab # [ 9.096633] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3787gitlab # [ 9.104110] systemd[1]: Starting nixbot CI service socket...788gitlab # [ 9.105128] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.789gitlab # [ 9.110010] systemd[1]: Listening on nixbot CI service socket.790gitlab # [ 9.111047] systemd[1]: Reached target Socket Units.791gitlab # [ 9.116088] systemd[1]: Starting D-Bus System Message Bus...792gitlab # [ 9.144144] systemd[1]: Starting Virtual Console Setup...793gitlab # [ 9.162230] dbus-broker-launch[562]: Looking up NSS user entry for 'systemd-timesync'...794gitlab # [ 9.163565] dbus-broker-launch[562]: NSS returned no entry for 'systemd-timesync'795gitlab # [ 9.165111] dbus-broker-launch[562]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"796gitlab # [ 9.167544] systemd[1]: Started D-Bus System Message Bus.797gitlab # [ 9.183174] dbus-broker-launch[562]: Ready798gitlab # [ 9.184779] systemd[1]: Reached target Basic System.799gitlab # [ 9.187131] systemd[1]: Started backdoor.service.800gitlab # [ 9.189591] systemd[1]: Starting gitlab-config.service...801gitlab # [ 9.192428] systemd[1]: Starting Import lastlog data into lastlog2 database...802gitlab # [ 9.208215] systemd[1]: Starting Logrotate configuration check...803gitlab # [ 9.216201] systemd[1]: Starting Name Service Cache Daemon (nsncd)...804gitlab # [ 9.223488] systemd[1]: Starting Post-Boot Actions...805gitlab # [ 9.224892] systemd[1]: Started Reset console on configuration changes.806gitlab # [ 9.231810] systemd[1]: Starting resolvconf update...807gitlab # connecting to host...808gitlab # [ 9.236801] systemd-vconsole-setup[566]: Configuration of first virtual console was skipped, ignoring remaining ones.809gitlab # [ 9.238842] logrotate[572]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.810gitlab # [ 9.243416] logrotate[572]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf811gitlab # [ 9.245378] logrotate[572]: note: 'monthly' overrides previously specified 'weekly'812gitlab # [ 9.246730] logrotate[572]: Reading state from file: /var/lib/logrotate.status813gitlab: Guest shell says: b'Spawning backdoor root shell...\n'814gitlab # [ 9.248007] logrotate[572]: state file /var/lib/logrotate.status does not exist815gitlab # [ 9.253498] logrotate[572]: Allocating hash table for state file, size 64 entries816gitlab: connected to guest root shell817gitlab # [ 9.254870] logrotate[572]: Handling 4 logs818gitlab: (connecting took 9.69 seconds)819gitlab # [ 9.255589] logrotate[572]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed820gitlab: (finished: waiting for the VM to finish booting, in 9.69 seconds)821gitlab # [ 9.259004] logrotate[572]: considering log /var/log/btmp822gitlab # [ 9.259921] logrotate[572]: Creating new state823gitlab # [ 9.260864] logrotate[572]: Now: 2026-08-20 05:53824gitlab # [ 9.261674] logrotate[572]: Last rotated at 2026-08-20 05:00825gitlab # [ 9.262590] logrotate[572]: log does not need rotating (log has already been rotated)826gitlab # [ 9.263855] logrotate[572]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed827gitlab # [ 9.267064] logrotate[572]: considering log /var/log/wtmp828gitlab # [ 9.267955] logrotate[572]: Creating new state829gitlab # [ 9.268807] logrotate[572]: Now: 2026-08-20 05:53830gitlab # [ 9.269709] logrotate[572]: Last rotated at 2026-08-20 05:00831gitlab # [ 9.271729] logrotate[572]: log does not need rotating (log has already been rotated)832gitlab # [ 9.273231] logrotate[572]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed833gitlab # [ 9.274995] logrotate[572]: switching euid from 0 to 165 and egid from 0 to 165 (pid 572)834gitlab # [ 9.276060] logrotate[572]: considering log /var/gitlab/state/log/*.log835gitlab # [ 9.276922] logrotate[572]: log /var/gitlab/state/log/*.log does not exist -- skipping836gitlab # [ 9.279211] logrotate[572]: Creating new state837gitlab # [ 9.279927] logrotate[572]: switching euid from 165 to 0 and egid from 165 to 0 (pid 572)838gitlab # [ 9.281162] logrotate[572]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed839gitlab # [ 9.282790] logrotate[572]: switching euid from 0 to 60 and egid from 0 to 60 (pid 572)840gitlab # [ 9.283914] logrotate[572]: considering log /var/log/nginx/*.log841gitlab # [ 9.284816] logrotate[572]: log /var/log/nginx/*.log does not exist -- skipping842gitlab # [ 9.285812] logrotate[572]: Creating new state843gitlab # [ 9.286416] logrotate[572]: not running postrotate script, since no logs were rotated844gitlab # [ 9.287488] logrotate[572]: switching euid from 60 to 0 and egid from 60 to 0 (pid 572)845gitlab # [ 9.290158] nsncd[573]: Aug 20 05:53:07.154 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"846gitlab # [ 9.292425] systemd[1]: Finished Virtual Console Setup.847gitlab # [ 9.293466] systemd[1]: Finished Logrotate configuration check.848gitlab # [ 9.294554] systemd[1]: Finished Post-Boot Actions.849gitlab # [ 9.295493] systemd[1]: Finished Import lastlog data into lastlog2 database.850gitlab # [ 9.297782] systemd[1]: Started Name Service Cache Daemon (nsncd).851gitlab # [ 9.299155] systemd[1]: Reached target Host and Network Name Lookups.852gitlab # [ 9.301138] systemd[1]: Reached target User and Group Name Lookups.853gitlab # [ 9.302049] systemd[1]: Starting User Login Management...854gitlab # [ 9.332035] systemd[1]: Stopped target Host and Network Name Lookups.855gitlab # [ 9.333306] systemd[1]: Stopping Host and Network Name Lookups...856gitlab # [ 9.334171] systemd[1]: Stopped target User and Group Name Lookups.857gitlab # [ 9.335105] systemd[1]: Stopping User and Group Name Lookups...858gitlab # [ 9.335968] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...859gitlab # [ 9.337807] systemd[1]: nscd.service: Deactivated successfully.860gitlab # [ 9.338883] systemd[1]: Stopped Name Service Cache Daemon (nsncd).861gitlab # [ 9.339762] systemd[1]: nscd.service: Consumed 27ms CPU time over 121ms wall clock time, 7.5M memory peak, 5.8M read from disk.862gitlab # [ 9.347520] systemd[1]: Starting Name Service Cache Daemon (nsncd)...863gitlab # [ 9.358126] systemd-logind[620]: New seat seat0.864gitlab # [ 9.361646] systemd-logind[620]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)865gitlab # [ 9.364619] systemd-logind[620]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)866gitlab # [ 9.366299] systemd-logind[620]: Watching system buttons on /dev/input/event0 (gpio-keys)867gitlab # [ 9.367650] systemd[1]: Started User Login Management.868gitlab # [ 9.379653] systemd[1]: Starting linger-users.service...869gitlab # [ 9.380733] systemd[1]: Finished resolvconf update.870gitlab # [ 9.381525] systemd[1]: Reached target Preparation for Network.871gitlab # [ 9.387768] nsncd[663]: Aug 20 05:53:07.263 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"872gitlab # [ 9.400652] systemd[1]: Starting DHCP Client...873gitlab # [ 9.405015] systemd[1]: Starting Address configuration of eth1...874gitlab # [ 9.413570] systemd[1]: Starting Extra networking commands....875gitlab # [ 9.414571] systemd[1]: Started Name Service Cache Daemon (nsncd).876gitlab # [ 9.415632] systemd[1]: linger-users.service: Deactivated successfully.877gitlab # [ 9.417525] systemd[1]: Finished linger-users.service.878gitlab # [ 9.419086] systemd[1]: Reached target Host and Network Name Lookups.879gitlab # [ 9.421100] systemd[1]: Reached target User and Group Name Lookups.880gitlab # [ 9.446648] network-addresses-eth1-start[690]: adding address 192.168.1.1/24... done881gitlab # [ 9.452332] network-addresses-eth1-start[690]: adding address 2001:db8:1::1/64... done882gitlab # [ 9.460383] systemd[1]: Finished Address configuration of eth1.883gitlab # [ 9.505366] systemd[1]: Finished Extra networking commands..884gitlab # [ 9.506265] systemd[1]: Reached target Network.885gitlab # [ 9.508423] systemd[1]: Starting gitlab-workhorse.service...886gitlab # [ 9.512327] systemd[1]: Starting Nginx Web Server...887gitlab # [ 9.519364] dhcpcd[704]: dhcpcd-10.3.2 starting888gitlab # [ 9.520463] systemd[1]: Starting PostgreSQL Server...889gitlab # [ 9.526336] dhcpcd[759]: dev: loaded udev890gitlab # [ 9.527073] systemd[1]: Starting Redis Server - redis-gitlab...891gitlab # [ 9.532164] systemd[1]: Starting Permit User Sessions...892gitlab # [ 9.545216] 8021q: 802.1Q VLAN Support v1.8893gitlab # [ 9.545681] 8021q: adding VLAN 0 to HW filter on device eth1894gitlab # [ 9.555865] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.895gitlab # [ 9.574677] systemd[1]: Finished Permit User Sessions.896gitlab # [ 9.584143] systemd[1]: Started Getty on tty1.897gitlab # [ 9.586648] systemd[1]: Reached target Login Prompts.898gitlab # [ 9.601613] cfg80211: Loading compiled-in X.509 certificates for regulatory database899gitlab # [ 9.613684] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'900gitlab # [ 9.614256] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'901gitlab # [ 9.621638] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2902gitlab # [ 9.622020] cfg80211: failed to load regulatory.db903gitlab # [ 9.661725] 8021q: adding VLAN 0 to HW filter on device eth0904gitlab # [ 9.660239] dhcpcd[759]: eth0: waiting for carrier905gitlab # [ 9.661867] dhcpcd[759]: eth0: carrier acquired906gitlab # [ 9.666740] dhcpcd[759]: DUID 00:01:00:01:32:19:52:c3:52:54:00:12:34:56907gitlab # [ 9.667850] dhcpcd[759]: eth0: IAID 00:12:34:56908gitlab # [ 9.668825] dhcpcd[759]: eth0: adding address fe80::5054:ff:fe12:3456909gitlab # [ 9.704117] nginx-pre-start[784]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok910gitlab # [ 9.705942] nginx-pre-start[784]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful911gitlab # [ 9.711985] systemd[1]: Started Nginx Web Server.912gitlab # [ 9.740720] redis-server[780]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.913gitlab # [ 9.743091] redis-server[780]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo914gitlab # [ 9.744205] redis-server[780]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=780, just started915gitlab # [ 9.746044] redis-server[780]: Configuration loaded916gitlab # [ 9.747042] systemd[1]: Started Redis Server - redis-gitlab.917gitlab # [ 9.747931] redis[780]: monotonic clock: ARM CNTVCT @ 1000 ticks/us918gitlab # [ 9.749156] redis[780]: Running mode=standalone, port=0.919gitlab # [ 9.750131] redis[780]: Server initialized920gitlab # [ 9.750940] redis[780]: Ready to accept connections unix921gitlab # [ 9.752055] redis[780]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.922gitlab # [ 9.770076] postgresql-pre-start[791]: The files belonging to this database system will be owned by user "postgres".923gitlab # [ 9.772123] postgresql-pre-start[791]: This user must also own the server process.924gitlab # [ 9.773716] postgresql-pre-start[791]: The database cluster will be initialized with locale "en_US.UTF-8".925gitlab # [ 9.774972] postgresql-pre-start[791]: The default database encoding has accordingly been set to "UTF8".926gitlab # [ 9.776382] postgresql-pre-start[791]: The default text search configuration will be set to "english".927gitlab # [ 9.777656] postgresql-pre-start[791]: Data page checksums are enabled.928gitlab # [ 9.778567] postgresql-pre-start[791]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok929gitlab # [ 9.779955] postgresql-pre-start[791]: creating subdirectories ... ok930gitlab # [ 9.781028] postgresql-pre-start[791]: selecting dynamic shared memory implementation ... posix931gitlab # [ 9.819376] postgresql-pre-start[791]: selecting default "max_connections" ... 100932gitlab # [ 9.871369] postgresql-pre-start[791]: selecting default "shared_buffers" ... 128MB933gitlab # [ 10.263157] systemd[1]: Started gitlab-workhorse.service.934gitlab # [ 10.332116] postgresql-pre-start[791]: selecting default time zone ... UTC935gitlab # [ 10.333830] postgresql-pre-start[791]: creating configuration files ... ok936gitlab # [ 10.575492] postgresql-pre-start[791]: running bootstrap script ... ok937gitlab # [ 10.660610] gitlab-workhorse[817]: time="2026-08-20T05:53:08Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4938gitlab # [ 10.662921] gitlab-workhorse[817]: time="2026-08-20T05:53:08Z" level=info msg="Using redis/go-redis"939gitlab # [ 10.665367] gitlab-workhorse[817]: time="2026-08-20T05:53:08Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix940gitlab # [ 10.916318] dhcpcd[759]: eth0: soliciting a DHCP lease941gitlab # [ 10.924838] dhcpcd[759]: eth0: offered 10.0.2.15 from 10.0.2.2942gitlab # [ 10.940591] dhcpcd[759]: eth0: probing address 10.0.2.15/24943gitlab # [ 11.138813] dhcpcd[759]: eth0: soliciting an IPv6 router944gitlab # [ 11.141955] dhcpcd[759]: eth0: Router Advertisement from fe80::2945gitlab # [ 11.144702] dhcpcd[759]: eth0: adding address fec0::5054:ff:fe12:3456/64946gitlab # [ 11.147556] dhcpcd[759]: eth0: adding route to fec0::/64947gitlab # [ 11.150020] dhcpcd[759]: eth0: adding default route via fe80::2948gitlab # [ 11.224578] postgresql-pre-start[791]: performing post-bootstrap initialization ... ok949gitlab # [ 11.579116] postgresql-pre-start[791]: syncing data to disk ... ok950gitlab # [ 11.582268] postgresql-pre-start[791]: initdb: warning: enabling "trust" authentication for local connections951gitlab # [ 11.586525] postgresql-pre-start[791]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.952gitlab # [ 11.593249] postgresql-pre-start[791]: Success. You can now start the database server using:953gitlab # [ 11.596791] postgresql-pre-start[791]: pg_ctl -D /var/lib/postgresql/18 -l logfile start954gitlab # [ 11.745182] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit955gitlab # [ 11.751075] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 5432956gitlab # [ 11.754505] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 5432957gitlab # [ 11.758327] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"958gitlab # [ 11.768532] postgres[860]: [860] LOG: database system was shut down at 2026-08-20 05:53:09 GMT959gitlab # [ 11.777982] postgres[851]: [851] LOG: database system is ready to accept connections960gitlab # [ 11.782989] systemd[1]: Started PostgreSQL Server.961gitlab # [ 11.795754] systemd[1]: Starting PostgreSQL Setup Scripts...962gitlab # [ 12.191447] postgresql-setup-start[871]: CREATE DATABASE963gitlab # [ 12.246521] postgresql-setup-start[881]: CREATE ROLE964gitlab # [ 12.271773] postgresql-setup-start[883]: ALTER DATABASE965gitlab # [ 12.326911] postgresql-setup-start[888]: CREATE ROLE966gitlab # [ 12.328873] systemd[1]: Finished PostgreSQL Setup Scripts.967gitlab # [ 12.330570] systemd[1]: Reached target PostgreSQL.968gitlab # [ 12.332899] systemd[1]: Starting gitlab-postgresql.service...969gitlab # [ 12.339089] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[876]: mkdir -p /var/gitlab/state/home/.ssh: OK970gitlab # [ 12.343372] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[876]: chmod 700 /var/gitlab/state/home/.ssh: OK971gitlab # [ 12.460827] systemd[1]: Finished gitlab-config.service.972gitlab # [ 12.468252] systemd[1]: Started gitaly.service.973gitlab # [ 12.482046] systemd[1]: Starting gitlab-db-config.service...974gitlab # [ 12.572943] gitlab-postgresql-start[907]: CREATE DATABASE975gitlab # [ 12.658831] gitlab-postgresql-start[926]: CREATE EXTENSION976gitlab # [ 12.793874] gitlab-postgresql-start[928]: CREATE EXTENSION977gitlab # [ 12.798563] systemd[1]: Finished gitlab-postgresql.service.978gitlab # [ 13.428625] gitaly[911]: time="2026-08-20T05:53:11.303Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=911979gitlab # [ 13.429030] gitaly[911]: time="2026-08-20T05:53:11.304Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=911980gitlab # [ 13.429174] gitaly[911]: time="2026-08-20T05:53:11.304Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=911981gitlab # [ 13.429293] gitaly[911]: time="2026-08-20T05:53:11.304Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=911982gitlab # [ 13.429394] gitaly[911]: time="2026-08-20T05:53:11.304Z" level=info msg="Starting Gitaly" pid=911 version=983gitlab # [ 13.689085] gitaly[911]: time="2026-08-20T05:53:11.564Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=259 pid=911984gitlab # [ 13.690967] gitaly[911]: time="2026-08-20T05:53:11.565Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=911985gitlab # [ 13.692785] gitaly[911]: time="2026-08-20T05:53:11.566Z" level=info msg="finished initializing command factory" duration_ms=0 pid=911986gitlab # [ 13.694602] gitaly[911]: time="2026-08-20T05:53:11.566Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-911/git-exec-4007911137.d/git pid=911987gitlab # [ 13.696618] gitaly[911]: time="2026-08-20T05:53:11.570Z" level=info msg="finished detecting git version" duration_ms=4 pid=911988gitlab # [ 13.698284] gitaly[911]: time="2026-08-20T05:53:11.570Z" level=info msg="using Git version" pid=911 version=2.53.g989gitlab # [ 13.699866] gitaly[911]: time="2026-08-20T05:53:11.571Z" level=info msg="clearing disk cache object folder" pid=911 storage=default990gitlab # [ 13.701926] gitaly[911]: time="2026-08-20T05:53:11.571Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache35651464 pid=911 storage=default991gitlab # [ 13.704663] gitaly[911]: time="2026-08-20T05:53:11.571Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache35651464 pid=911 storage=default992gitlab # [ 13.708064] gitaly[911]: time="2026-08-20T05:53:11.571Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=911993gitlab # [ 13.711797] gitaly[911]: time="2026-08-20T05:53:11.571Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=911994gitlab # [ 13.715537] gitaly[911]: time="2026-08-20T05:53:11.571Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache35651464 clear_duration_ms=0 pid=911 storage=default995gitlab # [ 13.719715] gitaly[911]: time="2026-08-20T05:53:11.586Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=911996gitlab # [ 13.723932] gitaly[911]: time="2026-08-20T05:53:11.586Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=911 schema=unix997gitlab # [ 13.726875] gitaly[911]: time="2026-08-20T05:53:11.586Z" level=info msg="listening at address" address=/run/gitaly/gitaly-911/sock.d/intern pid=911 schema=unix998gitlab # [ 13.729774] gitaly[911]: time="2026-08-20T05:53:11.586Z" level=info msg="finished tempdir cleaner walk" pid=911 storage=default time_ms=0999gitlab # [ 13.732075] gitaly[911]: time="2026-08-20T05:53:11.586Z" level=info msg="counting repositories" pid=9111000gitlab # [ 13.733731] gitaly[911]: time="2026-08-20T05:53:11.586Z" level=info msg="starting to count repositories" pid=911 storage_path=/var/gitlab/state/repositories1001gitlab # [ 13.736458] gitaly[911]: time="2026-08-20T05:53:11.586Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=911 storage_path=/var/gitlab/state/repositories1002gitlab # [ 13.739275] gitaly[911]: time="2026-08-20T05:53:11.586Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9111003gitlab # [ 13.741573] gitaly[911]: time="2026-08-20T05:53:11.587Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9111004gitlab # [ 13.743797] gitaly[911]: time="2026-08-20T05:53:11.587Z" level=info msg="Started Gitaly" duration_ms=283 pid=9111005gitlab # [ 13.745901] gitaly[911]: time="2026-08-20T05:53:11.587Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9111006gitlab # [ 13.747990] gitaly[911]: time="2026-08-20T05:53:11.588Z" level=info msg="maintenance: daily scheduled" pid=911 scheduled="2026-08-20 12:00:00 +0000 UTC"1007gitlab # [ 14.346330] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1008gitlab # [ 14.355142] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1009gitlab # [ 14.372254] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1010gitlab # [ 15.813405] dhcpcd[759]: eth0: leased 10.0.2.15 for 86400 seconds1011gitlab # [ 15.813732] dhcpcd[759]: eth0: adding route to 10.0.2.0/241012gitlab # [ 15.813868] dhcpcd[759]: eth0: adding default route via 10.0.2.21013gitlab # [ 15.974876] systemd[1]: Started DHCP Client.1014gitlab # [ 15.980490] systemd[1]: Reached target Network is Online.1015gitlab # [ 17.233466] gitaly[911]: time="2026-08-20T05:53:15.108Z" level=info msg="License database preloaded" duration_ms=3803 pid=9111016gitlab # [ 63.996523] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[922]: W, [2026-08-20T05:54:01.870529 #922] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1017gitlab # [ 67.458276] postgres[1478]: [1478] ERROR: relation "feature_gates" does not exist at character 5231018gitlab # [ 67.458806] postgres[1478]: [1478] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1019gitlab # [ 67.458936] postgres[1478]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1020gitlab # [ 67.459056] postgres[1478]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1021gitlab # [ 67.459176] postgres[1478]: attidentity AS identity,1022gitlab # [ 67.459297] postgres[1478]: attgenerated as attgenerated1023gitlab # [ 67.459418] postgres[1478]: FROM pg_attribute a1024gitlab # [ 67.459542] postgres[1478]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1025gitlab # [ 67.459688] postgres[1478]: LEFT JOIN pg_type t ON a.atttypid = t.oid1026gitlab # [ 67.459805] postgres[1478]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1027gitlab # [ 67.459926] postgres[1478]: WHERE a.attrelid = '"feature_gates"'::regclass1028gitlab # [ 67.493126] postgres[1478]: AND a.attnum > 0 AND NOT a.attisdropped1029gitlab # [ 67.495824] postgres[1478]: ORDER BY a.attnum1030gitlab # [ 67.497862] postgres[1478]:1031gitlab # [ 70.784991] gitlab-workhorse[817]: time="2026-08-20T05:54:08Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1032gitlab # [ 72.791510] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1530]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1033gitlab # [ 72.791989] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1530]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1034gitlab # [ 80.795926] gitlab-workhorse[817]: time="2026-08-20T05:54:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 90.802534] gitlab-workhorse[817]: time="2026-08-20T05:54:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1036gitlab # [ 100.700621] postgres[1632]: [1632] ERROR: relation "table_without_models" does not exist1037gitlab # [ 100.701374] postgres[1632]: [1632] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1038gitlab # [ 100.814214] gitlab-workhorse[817]: time="2026-08-20T05:54:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 110.822490] gitlab-workhorse[817]: time="2026-08-20T05:54:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 120.830352] gitlab-workhorse[817]: time="2026-08-20T05:54:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 130.834139] gitlab-workhorse[817]: time="2026-08-20T05:55:08Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 133.028733] systemd[1]: Finished gitlab-db-config.service.1043gitlab # [ 133.032579] systemd[1]: Started gitlab-sidekiq.service.1044gitlab # [ 133.036413] systemd[1]: Starting gitlab.service...1045gitlab # [ 133.704368] bundle[2036]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1046gitlab # [ 133.704933] bundle[2036]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1047gitlab # [ 133.708101] bundle[2036]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1048gitlab # [ 138.438703] bundle[2036]: {"timestamp":"2026-08-20T05:55:16.283Z","pid":2036,"message":"* Enabling systemd notification integration"}1049gitlab # [ 138.439189] bundle[2036]: {"timestamp":"2026-08-20T05:55:16.313Z","pid":2036,"message":"Puma starting in cluster mode..."}1050gitlab # [ 138.439304] bundle[2036]: {"timestamp":"2026-08-20T05:55:16.313Z","pid":2036,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1051gitlab # [ 138.439471] bundle[2036]: {"timestamp":"2026-08-20T05:55:16.313Z","pid":2036,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1052gitlab # [ 138.439588] bundle[2036]: {"timestamp":"2026-08-20T05:55:16.313Z","pid":2036,"message":"* Min threads: 0"}1053gitlab # [ 138.439725] bundle[2036]: {"timestamp":"2026-08-20T05:55:16.313Z","pid":2036,"message":"* Max threads: 4"}1054gitlab # [ 138.439867] bundle[2036]: {"timestamp":"2026-08-20T05:55:16.313Z","pid":2036,"message":"* Environment: production"}1055gitlab # [ 138.440009] bundle[2036]: {"timestamp":"2026-08-20T05:55:16.313Z","pid":2036,"message":"* Master PID: 2036"}1056gitlab # [ 138.475949] bundle[2036]: {"timestamp":"2026-08-20T05:55:16.313Z","pid":2036,"message":"* Workers: 2"}1057gitlab # [ 138.480233] bundle[2036]: {"timestamp":"2026-08-20T05:55:16.313Z","pid":2036,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1058gitlab # [ 138.485361] bundle[2036]: {"timestamp":"2026-08-20T05:55:16.313Z","pid":2036,"message":"* Preloading application"}1059gitlab # [ 138.628127] sidekiq-cluster[2035]: {"severity":"INFO","time":"2026-08-20T05:55:16.468Z","message":"Starting cluster with 1 processes"}1060gitlab # [ 140.838325] gitlab-workhorse[817]: time="2026-08-20T05:55:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1061gitlab # [ 150.839884] gitlab-workhorse[817]: time="2026-08-20T05:55:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1062gitlab # [ 160.841284] gitlab-workhorse[817]: time="2026-08-20T05:55:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 170.842435] gitlab-workhorse[817]: time="2026-08-20T05:55:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 178.422353] bundle[2036]: W, [2026-08-20T05:55:56.296910 #2036] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1065gitlab # [ 180.850341] gitlab-workhorse[817]: time="2026-08-20T05:55:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 184.058280] sidekiq-cluster[2084]: 2026-08-20T05:56:01.932Z pid=2084 tid=xos INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2084, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>424177664}1067gitlab # [ 184.378361] sidekiq-cluster[2084]: W, [2026-08-20T05:56:02.253799 #2084] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1068gitlab # [ 184.572774] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:02.448Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1069gitlab # [ 187.975792] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.850Z","message":"GitLab reliable fetch activated!"}1070gitlab # [ 187.976201] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.850Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1071gitlab # [ 188.025148] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.900Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1072gitlab # [ 188.032263] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.906Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1073gitlab # [ 188.039317] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.912Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1074gitlab # [ 188.046042] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.918Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1075gitlab # [ 188.053535] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.924Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1076gitlab # [ 188.060321] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.929Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1077gitlab # [ 188.067079] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.934Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1078gitlab # [ 188.073072] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.937Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1079gitlab # [ 188.078240] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.940Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1080gitlab # [ 188.083075] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.944Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1081gitlab # [ 188.088124] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.946Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1082gitlab # [ 188.092403] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.950Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1083gitlab # [ 188.096092] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.954Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1084gitlab # [ 188.099814] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.956Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1085gitlab # [ 188.103504] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.959Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1086gitlab # [ 188.107042] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.963Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1087gitlab # [ 188.110259] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.968Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1088gitlab # [ 188.113269] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.971Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1089gitlab # [ 188.116404] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.975Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1090gitlab # [ 188.119243] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.979Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1091gitlab # [ 188.122440] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.983Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1092gitlab # [ 188.125646] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.987Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1093gitlab # [ 188.128279] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.990Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1094gitlab # [ 188.130877] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.994Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1095gitlab # [ 188.133536] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:05.997Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1096gitlab # [ 188.135853] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.000Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1097gitlab # [ 188.138290] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.004Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1098gitlab # [ 188.140598] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.007Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1099gitlab # [ 188.142932] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.010Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1100gitlab # [ 188.145502] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.013Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1101gitlab # [ 188.147657] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.016Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1102gitlab # [ 188.150248] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.019Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1103gitlab # [ 188.152396] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.022Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1104gitlab # [ 188.154619] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.025Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1105gitlab # [ 188.156816] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.027Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1106gitlab # [ 188.158898] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.030Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1107gitlab # [ 188.161074] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.032Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1108gitlab # [ 188.163071] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.034Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1109gitlab # [ 188.165174] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.036Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1110gitlab # [ 188.167157] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.038Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1111gitlab # [ 188.169405] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.041Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1112gitlab # [ 188.171475] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.043Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1113gitlab # [ 188.173712] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.045Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1114gitlab # [ 188.175716] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.047Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1115gitlab # [ 188.177989] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.050Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1116gitlab # [ 188.180209] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.052Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1117gitlab # [ 188.182275] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.054Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1118gitlab # [ 188.184371] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.057Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1119gitlab # [ 188.186427] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.059Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1120gitlab # [ 188.188534] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.061Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1121gitlab # [ 188.190585] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.064Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1122gitlab # [ 188.192654] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.067Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1123gitlab # [ 188.204514] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.080Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1124gitlab # [ 188.207886] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.083Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1125gitlab # [ 188.210770] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.086Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1126gitlab # [ 188.213428] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.089Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1127gitlab # [ 188.217199] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.091Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1128gitlab # [ 188.221372] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.094Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1129gitlab # [ 188.225375] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.096Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1130gitlab # [ 188.303554] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.177Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1131gitlab # [ 188.310059] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.182Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1132gitlab # [ 188.316341] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.184Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1133gitlab # [ 188.322830] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.187Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1134gitlab # [ 188.329592] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.191Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1135gitlab # [ 188.336479] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.194Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1136gitlab # [ 188.342556] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.197Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1137gitlab # [ 188.347799] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.200Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1138gitlab # [ 188.352943] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.203Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1139gitlab # [ 188.357700] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.204Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1140gitlab # [ 188.362150] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.207Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1141gitlab # [ 188.366427] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.209Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1142gitlab # [ 188.370438] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.212Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1143gitlab # [ 188.374271] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.214Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1144gitlab # [ 188.378132] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.218Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1145gitlab # [ 188.381763] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.220Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1146gitlab # [ 188.385216] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.222Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1147gitlab # [ 188.388343] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.225Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1148gitlab # [ 188.391647] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.227Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1149gitlab # [ 188.394677] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.229Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1150gitlab # [ 188.397487] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.231Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1151gitlab # [ 188.400357] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.234Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1152gitlab # [ 188.403235] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.236Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1153gitlab # [ 188.406062] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.240Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1154gitlab # [ 188.408605] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.242Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1155gitlab # [ 188.411189] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.245Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1156gitlab # [ 188.413753] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.247Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1157gitlab # [ 188.417279] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.250Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1158gitlab # [ 188.419620] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.252Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1159gitlab # [ 188.422149] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.254Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1160gitlab # [ 188.424536] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.256Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1161gitlab # [ 188.426836] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.259Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1162gitlab # [ 188.429176] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.261Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1163gitlab # [ 188.431467] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.264Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1164gitlab # [ 188.434063] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.266Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1165gitlab # [ 188.436147] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.269Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1166gitlab # [ 188.438554] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.272Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1167gitlab # [ 188.440962] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.275Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1168gitlab # [ 188.443287] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.278Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1169gitlab # [ 188.445707] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.293Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1170gitlab # [ 188.448001] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.296Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1171gitlab # [ 188.450254] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.298Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1172gitlab # [ 188.452612] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.302Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1173gitlab # [ 188.454721] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.305Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1174gitlab # [ 188.457064] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.308Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1175gitlab # [ 188.459488] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.312Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1176gitlab # [ 188.462065] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.314Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1177gitlab # [ 188.464281] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.317Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1178gitlab # [ 188.466636] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.320Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1179gitlab # [ 188.469015] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:06.323Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1180gitlab # [ 190.857838] gitlab-workhorse[817]: time="2026-08-20T05:56:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1181gitlab # [ 200.867880] gitlab-workhorse[817]: time="2026-08-20T05:56:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1182gitlab # [ 210.878361] gitlab-workhorse[817]: time="2026-08-20T05:56:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 220.886540] gitlab-workhorse[817]: time="2026-08-20T05:56:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 229.350692] postgres[2848]: [2848] ERROR: relation "table_without_models" does not exist1185gitlab # [ 229.354410] postgres[2848]: [2848] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1186gitlab # [ 230.894384] gitlab-workhorse[817]: time="2026-08-20T05:56:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 232.751241] postgres[2877]: [2877] ERROR: relation "table_without_models" does not exist1188gitlab # [ 232.755079] postgres[2877]: [2877] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1189gitlab # [ 234.569172] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:52.444Z","message":"Booted Rails 7.2.3.1 application in production environment"}1190gitlab # [ 234.574741] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:52.450Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1191gitlab # [ 234.582503] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:52.450Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1192gitlab # [ 234.588257] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:52.450Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1193gitlab # [ 234.594355] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:52.458Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1194gitlab # [ 237.407289] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:55.281Z","message":"Cleaning working queues"}1195gitlab # [ 237.410034] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:55.285Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b337559fe24b1239f5a33039","created_at":"2026-08-20T05:55:10.330Z","trace_propagation_headers":{"sentry-trace":"8633cc5adea5465bb3a28d245d40f1fc-f3805e42191c4964","baggage":"sentry-trace_id=8633cc5adea5465bb3a28d245d40f1fc,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"728269d04cf13527368232f231caf60a","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:10.342Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b337559fe24b1239f5a33039: start","job_status":"start","queue_duration_s":104.941917,"scheduling_latency_s":104.942017}1196gitlab # [ 237.792583] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:56:55.667Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b337559fe24b1239f5a33039","created_at":"2026-08-20T05:55:10.330Z","trace_propagation_headers":{"sentry-trace":"8633cc5adea5465bb3a28d245d40f1fc-f3805e42191c4964","baggage":"sentry-trace_id=8633cc5adea5465bb3a28d245d40f1fc,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"728269d04cf13527368232f231caf60a","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:10.342Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b337559fe24b1239f5a33039: done: 0.382615 sec","job_status":"done","queue_duration_s":104.941917,"scheduling_latency_s":104.942017,"redis_calls":29,"redis_duration_s":0.011821,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.00697,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003066,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001785,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.199355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19792648000000002,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.382615,"completed_at":"2026-08-20T05:56:55.667Z","load_balancing_strategy":"primary","db_duration_s":0.106593,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1197gitlab # [ 238.791899] bundle[2036]: {"timestamp":"2026-08-20T05:56:56.666Z","pid":2036,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1198gitlab # [ 238.797633] bundle[2036]: {"timestamp":"2026-08-20T05:56:56.666Z","pid":2036,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1199gitlab # [ 238.802874] bundle[2036]: {"timestamp":"2026-08-20T05:56:56.666Z","pid":2036,"message":"! #\u003cThread:0x0000e43301791238 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1200gitlab # [ 238.819062] bundle[2036]: {"timestamp":"2026-08-20T05:56:56.666Z","pid":2036,"message":"! #\u003cThread:0x0000e43300568908 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1201gitlab # [ 238.835137] bundle[2036]: {"timestamp":"2026-08-20T05:56:56.667Z","pid":2036,"message":"Use Ctrl-C to stop"}1202gitlab # [ 238.839238] bundle[2036]: {"timestamp":"2026-08-20T05:56:56.667Z","pid":2036,"message":"Sending status to systemd every 1.0 sec"}1203gitlab # [ 239.444425] bundle[2036]: {"timestamp":"2026-08-20T05:56:57.319Z","pid":2036,"message":"- Worker 0 (PID: 2995) booted in 0.6s, phase: 0"}1204gitlab # [ 239.527781] bundle[2036]: {"timestamp":"2026-08-20T05:56:57.403Z","pid":2036,"message":"- Worker 1 (PID: 3000) booted in 0.66s, phase: 0"}1205gitlab # [ 239.535875] systemd[1]: Started gitlab.service.1206gitlab # [ 239.536689] systemd[1]: Reached target Common target for all GitLab services..1207gitlab # [ 239.542626] systemd[1]: Starting setup-gitlab.service...1208gitlab # [ 239.571994] setup-gitlab-start[3024]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1209gitlab # [ 243.745512] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:01 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 41221210gitlab # [ 243.755953] setup-gitlab-start[3024]: + TOKEN=nixbot-test-token-of-20-chars1211gitlab # [ 243.759713] setup-gitlab-start[3024]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1212gitlab # [ 243.785056] runuser[3054]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1213gitlab # [ 244.769627] setup-gitlab-start[3055]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1214gitlab # [ 244.777199] setup-gitlab-start[3055]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1215gitlab # [ 244.783655] setup-gitlab-start[3055]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1216gitlab # [ 246.131447] setup-gitlab-start[3055]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1217gitlab # [ 246.138398] setup-gitlab-start[3055]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1218gitlab # [ 246.145025] setup-gitlab-start[3055]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1219gitlab # [ 248.612937] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:06.486Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a11ddc6f3f72d69062dd94f6","created_at":"2026-08-20T05:57:06.385Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06b86e83629f64d51db9909002600d4b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.483Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a11ddc6f3f72d69062dd94f6: start","job_status":"start","queue_duration_s":0.003241,"scheduling_latency_s":0.003292}1220gitlab # [ 248.861436] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:06.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a11ddc6f3f72d69062dd94f6","created_at":"2026-08-20T05:57:06.385Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06b86e83629f64d51db9909002600d4b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.483Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a11ddc6f3f72d69062dd94f6: done: 0.24899 sec","job_status":"done","queue_duration_s":0.003241,"scheduling_latency_s":0.003292,"redis_calls":10,"redis_duration_s":0.025195,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003841,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006571,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0028498,"duration_s":0.24899,"completed_at":"2026-08-20T05:57:06.735Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1221gitlab # [ 248.959375] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:06.744Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c95ad6b0127416848537f629","created_at":"2026-08-20T05:57:06.504Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fa0b4a95a3bc05afae017066f72624f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.561Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c95ad6b0127416848537f629: start","job_status":"start","queue_duration_s":0.183366,"scheduling_latency_s":0.183427}1222gitlab # [ 248.978043] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:06.799Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1223gitlab # [ 248.982216] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:06.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c95ad6b0127416848537f629","created_at":"2026-08-20T05:57:06.504Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fa0b4a95a3bc05afae017066f72624f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.561Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c95ad6b0127416848537f629: done: 0.088439 sec","job_status":"done","queue_duration_s":0.183366,"scheduling_latency_s":0.183427,"redis_calls":10,"redis_duration_s":0.017439,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000847,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011414,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005178,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00455412,"duration_s":0.088439,"completed_at":"2026-08-20T05:57:06.832Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000947,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 249.025222] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:06.844Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f526141b17c7e90daad2cf46","created_at":"2026-08-20T05:57:06.621Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf08d5f179f816e0ed77e43a21658db4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.632Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f526141b17c7e90daad2cf46: start","job_status":"start","queue_duration_s":0.211668,"scheduling_latency_s":0.21172}1225gitlab # [ 249.153924] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.028Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f526141b17c7e90daad2cf46","created_at":"2026-08-20T05:57:06.621Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf08d5f179f816e0ed77e43a21658db4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.632Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f526141b17c7e90daad2cf46: done: 0.183752 sec","job_status":"done","queue_duration_s":0.211668,"scheduling_latency_s":0.21172,"redis_calls":12,"redis_duration_s":0.045518,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004711,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.031815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008992,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0042674,"exclusive_lock_hold_duration_s":0.051450539999999996,"duration_s":0.183752,"completed_at":"2026-08-20T05:57:07.028Z","load_balancing_strategy":"primary","db_duration_s":0.039044,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 249.242533] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.037Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"98c13822f73a23d74187ed40","created_at":"2026-08-20T05:57:06.653Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9886682aac6bf9224189c1975dd6aae9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.681Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-98c13822f73a23d74187ed40: start","job_status":"start","queue_duration_s":0.356141,"scheduling_latency_s":0.356197}1227gitlab # [ 249.260223] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"98c13822f73a23d74187ed40","created_at":"2026-08-20T05:57:06.653Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9886682aac6bf9224189c1975dd6aae9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.681Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-98c13822f73a23d74187ed40: done: 0.093361 sec","job_status":"done","queue_duration_s":0.356141,"scheduling_latency_s":0.356197,"redis_calls":12,"redis_duration_s":0.005345,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001084,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002322,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00169226,"exclusive_lock_hold_duration_s":0.01821836,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.093361,"completed_at":"2026-08-20T05:57:07.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 249.307527] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.134Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b4d706e587b87c6c293359a2","created_at":"2026-08-20T05:57:06.708Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8223501d93129208c5e895031f5d0cbb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.739Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b4d706e587b87c6c293359a2: start","job_status":"start","queue_duration_s":0.394878,"scheduling_latency_s":0.394928}1229gitlab # [ 249.490511] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.364Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b4d706e587b87c6c293359a2","created_at":"2026-08-20T05:57:06.708Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8223501d93129208c5e895031f5d0cbb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.739Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b4d706e587b87c6c293359a2: done: 0.230435 sec","job_status":"done","queue_duration_s":0.394878,"scheduling_latency_s":0.394928,"redis_calls":16,"redis_duration_s":0.083969,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.006998,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.06322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00456424,"duration_s":0.230435,"completed_at":"2026-08-20T05:57:07.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.057922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 249.579366] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"844e57944c2136aec9d42a3e","created_at":"2026-08-20T05:57:06.761Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0f19622266889eba27a9cfd9608b347","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.813Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-844e57944c2136aec9d42a3e: start","job_status":"start","queue_duration_s":0.571327,"scheduling_latency_s":0.571382}1231gitlab # [ 249.805953] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"844e57944c2136aec9d42a3e","created_at":"2026-08-20T05:57:06.761Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0f19622266889eba27a9cfd9608b347","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.813Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-844e57944c2136aec9d42a3e: done: 0.294142 sec","job_status":"done","queue_duration_s":0.571327,"scheduling_latency_s":0.571382,"redis_calls":19,"redis_duration_s":0.084529,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.008784,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.001429,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.052977,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.021339,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00409872,"duration_s":0.294142,"completed_at":"2026-08-20T05:57:07.678Z","load_balancing_strategy":"primary","db_duration_s":0.007956,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1232gitlab # [ 249.901522] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"746bb17f74a2d729bc4a9931","created_at":"2026-08-20T05:57:06.842Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af736a04ee137b2ca738e0629ad840ab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.863Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-746bb17f74a2d729bc4a9931: start","job_status":"start","queue_duration_s":0.84338,"scheduling_latency_s":0.843445}1233gitlab # [ 249.919562] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"746bb17f74a2d729bc4a9931","created_at":"2026-08-20T05:57:06.842Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af736a04ee137b2ca738e0629ad840ab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.863Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-746bb17f74a2d729bc4a9931: done: 0.062694 sec","job_status":"done","queue_duration_s":0.84338,"scheduling_latency_s":0.843445,"redis_calls":12,"redis_duration_s":0.005635,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001922,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00111316,"duration_s":0.062694,"completed_at":"2026-08-20T05:57:07.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001687,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1234gitlab # [ 249.969680] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"c60f7633decab7cde0f8005b","created_at":"2026-08-20T05:57:06.913Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2095684e7974ac08bfa6a06bc3e3991","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.942Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-c60f7633decab7cde0f8005b: start","job_status":"start","queue_duration_s":0.83027,"scheduling_latency_s":0.830349}1235gitlab # [ 249.985751] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"c60f7633decab7cde0f8005b","created_at":"2026-08-20T05:57:06.913Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2095684e7974ac08bfa6a06bc3e3991","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:06.942Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-c60f7633decab7cde0f8005b: done: 0.034351 sec","job_status":"done","queue_duration_s":0.83027,"scheduling_latency_s":0.830349,"redis_calls":10,"redis_duration_s":0.002876,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000594,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000589,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043854,"duration_s":0.034351,"completed_at":"2026-08-20T05:57:07.806Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 250.028428] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.809Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8486e71ed72c94774c3d743b","created_at":"2026-08-20T05:57:06.968Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1da9326f7f4967cf3d191b98ad1a4f59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:57:06.992Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8486e71ed72c94774c3d743b: start","job_status":"start","queue_duration_s":0.817072,"scheduling_latency_s":0.817095}1237gitlab # [ 250.041904] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.825Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1238gitlab # [ 250.045254] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.834Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8486e71ed72c94774c3d743b","created_at":"2026-08-20T05:57:06.968Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1da9326f7f4967cf3d191b98ad1a4f59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:57:06.992Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8486e71ed72c94774c3d743b: done: 0.025439 sec","job_status":"done","queue_duration_s":0.817072,"scheduling_latency_s":0.817095,"redis_calls":10,"redis_duration_s":0.002852,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00075,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001541,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000561,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062476,"duration_s":0.025439,"completed_at":"2026-08-20T05:57:07.834Z","load_balancing_strategy":"primary","db_duration_s":0.000464,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 250.086558] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0668c1a6255e1305aacdb4e3","created_at":"2026-08-20T05:57:07.019Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3dcae9df652b3941d3fa373db9230ba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.040Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0668c1a6255e1305aacdb4e3: start","job_status":"start","queue_duration_s":0.795693,"scheduling_latency_s":0.795712}1240gitlab # [ 250.101494] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.912Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0668c1a6255e1305aacdb4e3","created_at":"2026-08-20T05:57:07.019Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3dcae9df652b3941d3fa373db9230ba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.040Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0668c1a6255e1305aacdb4e3: done: 0.076678 sec","job_status":"done","queue_duration_s":0.795693,"scheduling_latency_s":0.795712,"redis_calls":12,"redis_duration_s":0.003125,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000511,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001437,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00082802,"exclusive_lock_hold_duration_s":0.041303099999999995,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.076678,"completed_at":"2026-08-20T05:57:07.912Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01697,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 250.148102] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.914Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"18a2f5fc5e5faee56acada24","created_at":"2026-08-20T05:57:07.098Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e32344ff71c43ac1ecd3737c2f65464","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.142Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-18a2f5fc5e5faee56acada24: start","job_status":"start","queue_duration_s":0.772642,"scheduling_latency_s":0.77266}1242gitlab # [ 250.162063] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"18a2f5fc5e5faee56acada24","created_at":"2026-08-20T05:57:07.098Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e32344ff71c43ac1ecd3737c2f65464","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.142Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-18a2f5fc5e5faee56acada24: done: 0.038715 sec","job_status":"done","queue_duration_s":0.772642,"scheduling_latency_s":0.77266,"redis_calls":10,"redis_duration_s":0.002669,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000538,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00157,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000561,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040176,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.038715,"completed_at":"2026-08-20T05:57:07.953Z","load_balancing_strategy":"primary","db_duration_s":0.0114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 250.204740] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3988805b2c613472a12b65f6","created_at":"2026-08-20T05:57:07.194Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec5b3d748fd340b5c8f925c4f651c076","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:57:07.209Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3988805b2c613472a12b65f6: start","job_status":"start","queue_duration_s":0.745726,"scheduling_latency_s":0.745744}1244gitlab # [ 250.217999] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3988805b2c613472a12b65f6","created_at":"2026-08-20T05:57:07.194Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec5b3d748fd340b5c8f925c4f651c076","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:57:07.209Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3988805b2c613472a12b65f6: done: 0.035088 sec","job_status":"done","queue_duration_s":0.745726,"scheduling_latency_s":0.745744,"redis_calls":10,"redis_duration_s":0.002578,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000597,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001467,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034652,"duration_s":0.035088,"completed_at":"2026-08-20T05:57:07.990Z","load_balancing_strategy":"primary","db_duration_s":0.003578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 250.259402] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:07.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"211f7cb26d49497f0d84a09c","created_at":"2026-08-20T05:57:07.226Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fe8b24e4f09722274c685f1c87051ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:57:07.250Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-211f7cb26d49497f0d84a09c: start","job_status":"start","queue_duration_s":0.741708,"scheduling_latency_s":0.741726}1246gitlab # [ 250.272798] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.004Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1247gitlab # [ 250.276437] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.012Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"211f7cb26d49497f0d84a09c","created_at":"2026-08-20T05:57:07.226Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fe8b24e4f09722274c685f1c87051ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:57:07.250Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-211f7cb26d49497f0d84a09c: done: 0.020577 sec","job_status":"done","queue_duration_s":0.741708,"scheduling_latency_s":0.741726,"redis_calls":10,"redis_duration_s":0.002362,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00141,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034464,"duration_s":0.020577,"completed_at":"2026-08-20T05:57:08.012Z","load_balancing_strategy":"primary","db_duration_s":0.000325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 250.318036] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.014Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b55e9411fc0e48cf859ecd9c","created_at":"2026-08-20T05:57:07.331Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.358Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b55e9411fc0e48cf859ecd9c: start","job_status":"start","queue_duration_s":0.655556,"scheduling_latency_s":0.655572}1249gitlab # [ 250.333066] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b55e9411fc0e48cf859ecd9c","created_at":"2026-08-20T05:57:07.331Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.358Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b55e9411fc0e48cf859ecd9c: done: 0.113703 sec","job_status":"done","queue_duration_s":0.655556,"scheduling_latency_s":0.655572,"redis_calls":71,"redis_duration_s":0.017925,"redis_read_bytes":120,"redis_write_bytes":42574,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00236,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001195,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013631,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035314,"duration_s":0.113703,"completed_at":"2026-08-20T05:57:08.127Z","load_balancing_strategy":"primary","db_duration_s":0.001518,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 250.376341] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.129Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c253fcee2707126ffabb627e","created_at":"2026-08-20T05:57:07.374Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04443dbc1454517b553fa8fda6243841","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.391Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c253fcee2707126ffabb627e: start","job_status":"start","queue_duration_s":0.738532,"scheduling_latency_s":0.738552}1251gitlab # [ 250.542437] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.417Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c253fcee2707126ffabb627e","created_at":"2026-08-20T05:57:07.374Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04443dbc1454517b553fa8fda6243841","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.391Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c253fcee2707126ffabb627e: done: 0.287821 sec","job_status":"done","queue_duration_s":0.738532,"scheduling_latency_s":0.738552,"redis_calls":14,"redis_duration_s":0.003857,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000952,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00133,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.069,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.069,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.199376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008405,"exclusive_lock_hold_duration_s":0.26298770000000005,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.287821,"completed_at":"2026-08-20T05:57:08.417Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.097933,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 250.629934] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0c1d12ad374216b47702ea09","created_at":"2026-08-20T05:57:07.396Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"767c75de01c22f882204de6e6881df62","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.406Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0c1d12ad374216b47702ea09: start","job_status":"start","queue_duration_s":1.013016,"scheduling_latency_s":1.013038}1253gitlab # [ 250.646648] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.475Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0c1d12ad374216b47702ea09","created_at":"2026-08-20T05:57:07.396Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"767c75de01c22f882204de6e6881df62","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.406Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0c1d12ad374216b47702ea09: done: 0.055346 sec","job_status":"done","queue_duration_s":1.013016,"scheduling_latency_s":1.013038,"redis_calls":12,"redis_duration_s":0.005495,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000565,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003301,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0026946,"exclusive_lock_hold_duration_s":0.0294903,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.055346,"completed_at":"2026-08-20T05:57:08.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 250.692645] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.477Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9e41cb39fe5810f6a7de3ade","created_at":"2026-08-20T05:57:07.412Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a67a4798295e9ea6a8c4be179f47260b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.420Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9e41cb39fe5810f6a7de3ade: start","job_status":"start","queue_duration_s":1.056703,"scheduling_latency_s":1.056723}1255gitlab # [ 250.707145] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.490Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1256gitlab # [ 250.710453] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9e41cb39fe5810f6a7de3ade","created_at":"2026-08-20T05:57:07.412Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a67a4798295e9ea6a8c4be179f47260b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.420Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9e41cb39fe5810f6a7de3ade: done: 0.021074 sec","job_status":"done","queue_duration_s":1.056703,"scheduling_latency_s":1.056723,"redis_calls":10,"redis_duration_s":0.002618,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000685,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001448,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035558,"duration_s":0.021074,"completed_at":"2026-08-20T05:57:08.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000527,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 250.754797] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c494fccf225f841674fe162f","created_at":"2026-08-20T05:57:07.440Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eec2da6a1c6c729271e9a5204b3ea2ec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.449Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c494fccf225f841674fe162f: start","job_status":"start","queue_duration_s":1.049964,"scheduling_latency_s":1.049981}1258gitlab # [ 250.769808] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.512Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1259gitlab # [ 250.773210] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c494fccf225f841674fe162f","created_at":"2026-08-20T05:57:07.440Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eec2da6a1c6c729271e9a5204b3ea2ec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.449Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c494fccf225f841674fe162f: done: 0.020498 sec","job_status":"done","queue_duration_s":1.049964,"scheduling_latency_s":1.049981,"redis_calls":10,"redis_duration_s":0.00243,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000509,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050106,"duration_s":0.020498,"completed_at":"2026-08-20T05:57:08.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 250.816171] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"db6a640aab4fc4ee30fd27b0","created_at":"2026-08-20T05:57:07.475Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d33a573b326da303fa1f21d5d7d6c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.507Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-db6a640aab4fc4ee30fd27b0: start","job_status":"start","queue_duration_s":1.013917,"scheduling_latency_s":1.013934}1261gitlab # [ 250.830821] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.533Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1262gitlab # [ 250.834733] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"db6a640aab4fc4ee30fd27b0","created_at":"2026-08-20T05:57:07.475Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d33a573b326da303fa1f21d5d7d6c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.507Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-db6a640aab4fc4ee30fd27b0: done: 0.019418 sec","job_status":"done","queue_duration_s":1.013917,"scheduling_latency_s":1.013934,"redis_calls":10,"redis_duration_s":0.002367,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001412,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048822,"duration_s":0.019418,"completed_at":"2026-08-20T05:57:08.541Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000331,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 250.877890] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b822eca1f9dd4728dd93ac04","created_at":"2026-08-20T05:57:07.547Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"445ed8c23a61c9e23b69a4a2c7ecac02","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.594Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b822eca1f9dd4728dd93ac04: start","job_status":"start","queue_duration_s":0.948887,"scheduling_latency_s":0.948903}1264gitlab # [ 250.892653] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b822eca1f9dd4728dd93ac04","created_at":"2026-08-20T05:57:07.547Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"445ed8c23a61c9e23b69a4a2c7ecac02","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.594Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b822eca1f9dd4728dd93ac04: done: 0.032584 sec","job_status":"done","queue_duration_s":0.948887,"scheduling_latency_s":0.948903,"redis_calls":13,"redis_duration_s":0.003143,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000465,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001613,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01009576,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.032584,"completed_at":"2026-08-20T05:57:08.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002334,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1265gitlab # [ 250.937089] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.577Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f010582c8df75d9e40d3d0fd","created_at":"2026-08-20T05:57:07.546Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e5bb23a1b8744cb9","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d0f19622266889eba27a9cfd9608b347","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.605Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f010582c8df75d9e40d3d0fd: start","job_status":"start","queue_duration_s":0.971406,"scheduling_latency_s":0.971423}1266gitlab # [ 250.950650] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.594Z","message":"No existing merge request to be cleaned up."}1267gitlab # [ 250.952314] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.609Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f010582c8df75d9e40d3d0fd","created_at":"2026-08-20T05:57:07.546Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e5bb23a1b8744cb9","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d0f19622266889eba27a9cfd9608b347","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.605Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f010582c8df75d9e40d3d0fd: done: 0.032281 sec","job_status":"done","queue_duration_s":0.971406,"scheduling_latency_s":0.971423,"redis_calls":13,"redis_duration_s":0.00366,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000475,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037116,"duration_s":0.032281,"completed_at":"2026-08-20T05:57:08.609Z","load_balancing_strategy":"primary","db_duration_s":0.003776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 250.993118] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.611Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ab0bcdd06e37cb9d42066ea1","created_at":"2026-08-20T05:57:07.546Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e5bb23a1b8744cb9","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d0f19622266889eba27a9cfd9608b347","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.605Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ab0bcdd06e37cb9d42066ea1: start","job_status":"start","queue_duration_s":1.00535,"scheduling_latency_s":1.005366}1269gitlab # [ 251.005626] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.621Z","message":"No existing merge request to be cleaned up."}1270gitlab # [ 251.007270] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.630Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ab0bcdd06e37cb9d42066ea1","created_at":"2026-08-20T05:57:07.546Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e5bb23a1b8744cb9","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d0f19622266889eba27a9cfd9608b347","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.605Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ab0bcdd06e37cb9d42066ea1: done: 0.019777 sec","job_status":"done","queue_duration_s":1.00535,"scheduling_latency_s":1.005366,"redis_calls":10,"redis_duration_s":0.002397,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001436,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019777,"completed_at":"2026-08-20T05:57:08.630Z","load_balancing_strategy":"primary","db_duration_s":0.001366,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 251.046297] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.632Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"17364cce34b498063acefc27","created_at":"2026-08-20T05:57:07.546Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e5bb23a1b8744cb9","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d0f19622266889eba27a9cfd9608b347","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.605Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-17364cce34b498063acefc27: start","job_status":"start","queue_duration_s":1.026588,"scheduling_latency_s":1.026604}1272gitlab # [ 251.058846] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.643Z","message":"No existing merge request to be cleaned up."}1273gitlab # [ 251.060551] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.651Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"17364cce34b498063acefc27","created_at":"2026-08-20T05:57:07.546Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e5bb23a1b8744cb9","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d0f19622266889eba27a9cfd9608b347","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.605Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-17364cce34b498063acefc27: done: 0.019326 sec","job_status":"done","queue_duration_s":1.026588,"scheduling_latency_s":1.026604,"redis_calls":10,"redis_duration_s":0.0023880000000000004,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001407,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019326,"completed_at":"2026-08-20T05:57:08.651Z","load_balancing_strategy":"primary","db_duration_s":0.001485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 251.099672] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.653Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5cbc1fa47af7b845da8f085c","created_at":"2026-08-20T05:57:07.546Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e5bb23a1b8744cb9","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d0f19622266889eba27a9cfd9608b347","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.605Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5cbc1fa47af7b845da8f085c: start","job_status":"start","queue_duration_s":1.047381,"scheduling_latency_s":1.047398}1275gitlab # [ 251.112341] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.663Z","message":"No existing merge request to be cleaned up."}1276gitlab # [ 251.114022] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.672Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5cbc1fa47af7b845da8f085c","created_at":"2026-08-20T05:57:07.546Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e5bb23a1b8744cb9","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d0f19622266889eba27a9cfd9608b347","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.605Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5cbc1fa47af7b845da8f085c: done: 0.019486 sec","job_status":"done","queue_duration_s":1.047381,"scheduling_latency_s":1.047398,"redis_calls":10,"redis_duration_s":0.002362,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019486,"completed_at":"2026-08-20T05:57:08.672Z","load_balancing_strategy":"primary","db_duration_s":0.001323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 251.153662] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:08.674Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"615007fb42553138b49acc65","created_at":"2026-08-20T05:57:07.646Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e89b51303af0dfa6b618dddee052234","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.673Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-615007fb42553138b49acc65: start","job_status":"start","queue_duration_s":1.000162,"scheduling_latency_s":1.000178}1278gitlab # [ 251.245346] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.120Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"615007fb42553138b49acc65","created_at":"2026-08-20T05:57:07.646Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e89b51303af0dfa6b618dddee052234","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:07.673Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-615007fb42553138b49acc65: done: 0.446545 sec","job_status":"done","queue_duration_s":1.000162,"scheduling_latency_s":1.000178,"redis_calls":565,"redis_duration_s":0.07189,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000525,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001538,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.069827,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.407675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035782,"duration_s":0.446545,"completed_at":"2026-08-20T05:57:09.120Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 251.309672] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d0fd8e1223ad10c3f855f58","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d0fd8e1223ad10c3f855f58: start","job_status":"start","queue_duration_s":1.004724,"scheduling_latency_s":1.004745}1280gitlab # [ 251.323767] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d0fd8e1223ad10c3f855f58","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d0fd8e1223ad10c3f855f58: done: 0.024596 sec","job_status":"done","queue_duration_s":1.004724,"scheduling_latency_s":1.004745,"redis_calls":16,"redis_duration_s":0.004188,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000559,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001215,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002414,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036268,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024596,"completed_at":"2026-08-20T05:57:09.146Z","load_balancing_strategy":"primary","db_duration_s":0.00054,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281gitlab # [ 251.368219] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3501e5322b0d263eff1d0c8","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3501e5322b0d263eff1d0c8: start","job_status":"start","queue_duration_s":1.030939,"scheduling_latency_s":1.030956}1282gitlab # [ 251.381415] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3501e5322b0d263eff1d0c8","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3501e5322b0d263eff1d0c8: done: 0.016754 sec","job_status":"done","queue_duration_s":1.030939,"scheduling_latency_s":1.030956,"redis_calls":13,"redis_duration_s":0.00294,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016754,"completed_at":"2026-08-20T05:57:09.165Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 251.421034] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50c1c3dde291197320469188","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50c1c3dde291197320469188: start","job_status":"start","queue_duration_s":1.049231,"scheduling_latency_s":1.049248}1284gitlab # [ 251.433490] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50c1c3dde291197320469188","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50c1c3dde291197320469188: done: 0.016559 sec","job_status":"done","queue_duration_s":1.049231,"scheduling_latency_s":1.049248,"redis_calls":13,"redis_duration_s":0.0028770000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016559,"completed_at":"2026-08-20T05:57:09.183Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 251.473135] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"347eff3ef80f47e26ce91c8f","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-347eff3ef80f47e26ce91c8f: start","job_status":"start","queue_duration_s":1.06734,"scheduling_latency_s":1.067358}1286gitlab # [ 251.485633] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"347eff3ef80f47e26ce91c8f","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-347eff3ef80f47e26ce91c8f: done: 0.0162 sec","job_status":"done","queue_duration_s":1.06734,"scheduling_latency_s":1.067358,"redis_calls":13,"redis_duration_s":0.002915,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0162,"completed_at":"2026-08-20T05:57:09.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 251.524852] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8c22aec23e6ff52d989b190","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8c22aec23e6ff52d989b190: start","job_status":"start","queue_duration_s":1.085786,"scheduling_latency_s":1.085804}1288gitlab # [ 251.540257] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8c22aec23e6ff52d989b190","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8c22aec23e6ff52d989b190: done: 0.015679 sec","job_status":"done","queue_duration_s":1.085786,"scheduling_latency_s":1.085804,"redis_calls":13,"redis_duration_s":0.002668,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015679,"completed_at":"2026-08-20T05:57:09.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 251.581751] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63292f68271dc14eed0ef946","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63292f68271dc14eed0ef946: start","job_status":"start","queue_duration_s":1.102892,"scheduling_latency_s":1.102907}1290gitlab # [ 251.594466] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63292f68271dc14eed0ef946","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63292f68271dc14eed0ef946: done: 0.016266 sec","job_status":"done","queue_duration_s":1.102892,"scheduling_latency_s":1.102907,"redis_calls":13,"redis_duration_s":0.003292,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00141,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016266,"completed_at":"2026-08-20T05:57:09.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 251.634604] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49574ab02388763847e4e653","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49574ab02388763847e4e653: start","job_status":"start","queue_duration_s":1.120609,"scheduling_latency_s":1.120625}1292gitlab # [ 251.647337] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49574ab02388763847e4e653","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49574ab02388763847e4e653: done: 0.015586 sec","job_status":"done","queue_duration_s":1.120609,"scheduling_latency_s":1.120625,"redis_calls":13,"redis_duration_s":0.002873,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015586,"completed_at":"2026-08-20T05:57:09.253Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 251.687137] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c3112c647fdc78b0f32e217","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c3112c647fdc78b0f32e217: start","job_status":"start","queue_duration_s":1.137628,"scheduling_latency_s":1.137643}1294gitlab # [ 251.699840] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c3112c647fdc78b0f32e217","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c3112c647fdc78b0f32e217: done: 0.015714 sec","job_status":"done","queue_duration_s":1.137628,"scheduling_latency_s":1.137643,"redis_calls":13,"redis_duration_s":0.002899,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015714,"completed_at":"2026-08-20T05:57:09.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 251.739368] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ae9833e4285e4522183e20e","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ae9833e4285e4522183e20e: start","job_status":"start","queue_duration_s":1.154836,"scheduling_latency_s":1.154852}1296gitlab # [ 251.752129] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ae9833e4285e4522183e20e","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ae9833e4285e4522183e20e: done: 0.01682 sec","job_status":"done","queue_duration_s":1.154836,"scheduling_latency_s":1.154852,"redis_calls":13,"redis_duration_s":0.002904,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01682,"completed_at":"2026-08-20T05:57:09.289Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 251.792523] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15b6d850d9206bfaff4e090f","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15b6d850d9206bfaff4e090f: start","job_status":"start","queue_duration_s":1.173152,"scheduling_latency_s":1.173168}1298gitlab # [ 251.804644] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15b6d850d9206bfaff4e090f","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15b6d850d9206bfaff4e090f: done: 0.015742 sec","job_status":"done","queue_duration_s":1.173152,"scheduling_latency_s":1.173168,"redis_calls":13,"redis_duration_s":0.002883,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015742,"completed_at":"2026-08-20T05:57:09.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 251.844865] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51d4e223f6af1579a1b94cbc","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51d4e223f6af1579a1b94cbc: start","job_status":"start","queue_duration_s":1.190274,"scheduling_latency_s":1.19029}1300gitlab # [ 251.857420] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51d4e223f6af1579a1b94cbc","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51d4e223f6af1579a1b94cbc: done: 0.015281 sec","job_status":"done","queue_duration_s":1.190274,"scheduling_latency_s":1.19029,"redis_calls":13,"redis_duration_s":0.0026,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015281,"completed_at":"2026-08-20T05:57:09.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 251.896972] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e4c988d17a0c38c12bf3eca","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e4c988d17a0c38c12bf3eca: start","job_status":"start","queue_duration_s":1.206904,"scheduling_latency_s":1.206919}1302gitlab # [ 251.909176] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e4c988d17a0c38c12bf3eca","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e4c988d17a0c38c12bf3eca: done: 0.017199 sec","job_status":"done","queue_duration_s":1.206904,"scheduling_latency_s":1.206919,"redis_calls":13,"redis_duration_s":0.002885,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017199,"completed_at":"2026-08-20T05:57:09.341Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 251.948619] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6daa67ee9ad7e6d619bd6d45","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6daa67ee9ad7e6d619bd6d45: start","job_status":"start","queue_duration_s":1.225571,"scheduling_latency_s":1.225587}1304gitlab # [ 251.962263] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6daa67ee9ad7e6d619bd6d45","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6daa67ee9ad7e6d619bd6d45: done: 0.015802 sec","job_status":"done","queue_duration_s":1.225571,"scheduling_latency_s":1.225587,"redis_calls":13,"redis_duration_s":0.002853,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015802,"completed_at":"2026-08-20T05:57:09.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 252.001543] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cc4fc9308947eb9ffbcc9bd","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cc4fc9308947eb9ffbcc9bd: start","job_status":"start","queue_duration_s":1.24276,"scheduling_latency_s":1.242774}1306gitlab # [ 252.014057] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cc4fc9308947eb9ffbcc9bd","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cc4fc9308947eb9ffbcc9bd: done: 0.01614 sec","job_status":"done","queue_duration_s":1.24276,"scheduling_latency_s":1.242774,"redis_calls":13,"redis_duration_s":0.002902,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01614,"completed_at":"2026-08-20T05:57:09.376Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 252.053556] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60ee19305bd334614ca25b32","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60ee19305bd334614ca25b32: start","job_status":"start","queue_duration_s":1.260441,"scheduling_latency_s":1.260458}1308gitlab # [ 252.066074] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60ee19305bd334614ca25b32","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60ee19305bd334614ca25b32: done: 0.015909 sec","job_status":"done","queue_duration_s":1.260441,"scheduling_latency_s":1.260458,"redis_calls":13,"redis_duration_s":0.0028120000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015909,"completed_at":"2026-08-20T05:57:09.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 252.105413] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c01d0e6d8513f938002986d5","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c01d0e6d8513f938002986d5: start","job_status":"start","queue_duration_s":1.278641,"scheduling_latency_s":1.278657}1310gitlab # [ 252.117907] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c01d0e6d8513f938002986d5","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c01d0e6d8513f938002986d5: done: 0.015215 sec","job_status":"done","queue_duration_s":1.278641,"scheduling_latency_s":1.278657,"redis_calls":13,"redis_duration_s":0.001702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015215,"completed_at":"2026-08-20T05:57:09.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 252.157380] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0f60690e2554651cc29e805","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0f60690e2554651cc29e805: start","job_status":"start","queue_duration_s":1.29531,"scheduling_latency_s":1.295327}1312gitlab # [ 252.171031] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0f60690e2554651cc29e805","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0f60690e2554651cc29e805: done: 0.016138 sec","job_status":"done","queue_duration_s":1.29531,"scheduling_latency_s":1.295327,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016138,"completed_at":"2026-08-20T05:57:09.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 252.210371] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dbfd7865b29994326b7a778","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dbfd7865b29994326b7a778: start","job_status":"start","queue_duration_s":1.312753,"scheduling_latency_s":1.31277}1314gitlab # [ 252.222930] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dbfd7865b29994326b7a778","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dbfd7865b29994326b7a778: done: 0.015092 sec","job_status":"done","queue_duration_s":1.312753,"scheduling_latency_s":1.31277,"redis_calls":13,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015092,"completed_at":"2026-08-20T05:57:09.445Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 252.262450] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"061b1fffa4e660baca1692b1","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-061b1fffa4e660baca1692b1: start","job_status":"start","queue_duration_s":1.329019,"scheduling_latency_s":1.329034}1316gitlab # [ 252.275492] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"061b1fffa4e660baca1692b1","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-061b1fffa4e660baca1692b1: done: 0.014679 sec","job_status":"done","queue_duration_s":1.329019,"scheduling_latency_s":1.329034,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014679,"completed_at":"2026-08-20T05:57:09.461Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 252.317784] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b10d262082424134e20955a","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b10d262082424134e20955a: start","job_status":"start","queue_duration_s":1.34564,"scheduling_latency_s":1.345657}1318gitlab # [ 252.331325] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b10d262082424134e20955a","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b10d262082424134e20955a: done: 0.015748 sec","job_status":"done","queue_duration_s":1.34564,"scheduling_latency_s":1.345657,"redis_calls":13,"redis_duration_s":0.0018610000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015748,"completed_at":"2026-08-20T05:57:09.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 252.373539] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a46e0f830f8bc8f0820f279b","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a46e0f830f8bc8f0820f279b: start","job_status":"start","queue_duration_s":1.36269,"scheduling_latency_s":1.362706}1320gitlab # [ 252.386125] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a46e0f830f8bc8f0820f279b","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a46e0f830f8bc8f0820f279b: done: 0.015067 sec","job_status":"done","queue_duration_s":1.36269,"scheduling_latency_s":1.362706,"redis_calls":13,"redis_duration_s":0.0017130000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015067,"completed_at":"2026-08-20T05:57:09.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 252.425061] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baaf3ab76b216d0a668082f0","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baaf3ab76b216d0a668082f0: start","job_status":"start","queue_duration_s":1.378916,"scheduling_latency_s":1.378932}1322gitlab # [ 252.437387] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baaf3ab76b216d0a668082f0","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baaf3ab76b216d0a668082f0: done: 0.014454 sec","job_status":"done","queue_duration_s":1.378916,"scheduling_latency_s":1.378932,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014454,"completed_at":"2026-08-20T05:57:09.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 252.476785] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c126e20e4b11be8533ae869","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c126e20e4b11be8533ae869: start","job_status":"start","queue_duration_s":1.39455,"scheduling_latency_s":1.394567}1324gitlab # [ 252.490074] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c126e20e4b11be8533ae869","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c126e20e4b11be8533ae869: done: 0.014793 sec","job_status":"done","queue_duration_s":1.39455,"scheduling_latency_s":1.394567,"redis_calls":13,"redis_duration_s":0.0014269999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014793,"completed_at":"2026-08-20T05:57:09.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 252.528637] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6320cd05fde0f889d4573e7","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6320cd05fde0f889d4573e7: start","job_status":"start","queue_duration_s":1.411764,"scheduling_latency_s":1.411782}1326gitlab # [ 252.540747] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6320cd05fde0f889d4573e7","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6320cd05fde0f889d4573e7: done: 0.01485 sec","job_status":"done","queue_duration_s":1.411764,"scheduling_latency_s":1.411782,"redis_calls":13,"redis_duration_s":0.001533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01485,"completed_at":"2026-08-20T05:57:09.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 252.580198] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd49ad1f902ea948546a50b4","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd49ad1f902ea948546a50b4: start","job_status":"start","queue_duration_s":1.427768,"scheduling_latency_s":1.427784}1328gitlab # [ 252.592277] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd49ad1f902ea948546a50b4","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd49ad1f902ea948546a50b4: done: 0.01433 sec","job_status":"done","queue_duration_s":1.427768,"scheduling_latency_s":1.427784,"redis_calls":13,"redis_duration_s":0.001915,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001351,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01433,"completed_at":"2026-08-20T05:57:09.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 252.631309] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"032cc4f095052da777f462a5","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-032cc4f095052da777f462a5: start","job_status":"start","queue_duration_s":1.443282,"scheduling_latency_s":1.4433}1330gitlab # [ 252.643393] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"032cc4f095052da777f462a5","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-032cc4f095052da777f462a5: done: 0.014349 sec","job_status":"done","queue_duration_s":1.443282,"scheduling_latency_s":1.4433,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014349,"completed_at":"2026-08-20T05:57:09.575Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 252.682655] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97bb2ae55a4469dbd9b18352","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97bb2ae55a4469dbd9b18352: start","job_status":"start","queue_duration_s":1.458814,"scheduling_latency_s":1.458831}1332gitlab # [ 252.694949] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97bb2ae55a4469dbd9b18352","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97bb2ae55a4469dbd9b18352: done: 0.014393 sec","job_status":"done","queue_duration_s":1.458814,"scheduling_latency_s":1.458831,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014393,"completed_at":"2026-08-20T05:57:09.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 252.733170] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd0e64e566ed15aaafa56eb0","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd0e64e566ed15aaafa56eb0: start","job_status":"start","queue_duration_s":1.474847,"scheduling_latency_s":1.474863}1334gitlab # [ 252.745344] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd0e64e566ed15aaafa56eb0","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd0e64e566ed15aaafa56eb0: done: 0.014692 sec","job_status":"done","queue_duration_s":1.474847,"scheduling_latency_s":1.474863,"redis_calls":13,"redis_duration_s":0.001626,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014692,"completed_at":"2026-08-20T05:57:09.607Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 252.785159] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aebbc2ff7f50cde245f67d85","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aebbc2ff7f50cde245f67d85: start","job_status":"start","queue_duration_s":1.490666,"scheduling_latency_s":1.490682}1336gitlab # [ 252.797307] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aebbc2ff7f50cde245f67d85","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aebbc2ff7f50cde245f67d85: done: 0.01431 sec","job_status":"done","queue_duration_s":1.490666,"scheduling_latency_s":1.490682,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01431,"completed_at":"2026-08-20T05:57:09.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 252.835747] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"723f95a04e08a8b49f80081c","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-723f95a04e08a8b49f80081c: start","job_status":"start","queue_duration_s":1.506082,"scheduling_latency_s":1.506098}1338gitlab # [ 252.848531] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"723f95a04e08a8b49f80081c","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-723f95a04e08a8b49f80081c: done: 0.014903 sec","job_status":"done","queue_duration_s":1.506082,"scheduling_latency_s":1.506098,"redis_calls":13,"redis_duration_s":0.001787,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014903,"completed_at":"2026-08-20T05:57:09.638Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 252.887073] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b4de777bf7e3db1c7509368","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b4de777bf7e3db1c7509368: start","job_status":"start","queue_duration_s":1.52217,"scheduling_latency_s":1.522187}1340gitlab # [ 252.899285] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b4de777bf7e3db1c7509368","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b4de777bf7e3db1c7509368: done: 0.014462 sec","job_status":"done","queue_duration_s":1.52217,"scheduling_latency_s":1.522187,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014462,"completed_at":"2026-08-20T05:57:09.654Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 252.937758] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3cda3caef0d581eb81beea8","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3cda3caef0d581eb81beea8: start","job_status":"start","queue_duration_s":1.538364,"scheduling_latency_s":1.53838}1342gitlab # [ 252.949981] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3cda3caef0d581eb81beea8","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3cda3caef0d581eb81beea8: done: 0.014442 sec","job_status":"done","queue_duration_s":1.538364,"scheduling_latency_s":1.53838,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014442,"completed_at":"2026-08-20T05:57:09.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 252.989221] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dcc5c54ec39175a4179fc9b","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dcc5c54ec39175a4179fc9b: start","job_status":"start","queue_duration_s":1.554012,"scheduling_latency_s":1.554029}1344gitlab # [ 253.001408] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dcc5c54ec39175a4179fc9b","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dcc5c54ec39175a4179fc9b: done: 0.01445 sec","job_status":"done","queue_duration_s":1.554012,"scheduling_latency_s":1.554029,"redis_calls":13,"redis_duration_s":0.001592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01445,"completed_at":"2026-08-20T05:57:09.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 253.040036] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4de1b3964b8c30360a6cd1f8","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4de1b3964b8c30360a6cd1f8: start","job_status":"start","queue_duration_s":1.569591,"scheduling_latency_s":1.569606}1346gitlab # [ 253.052105] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4de1b3964b8c30360a6cd1f8","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4de1b3964b8c30360a6cd1f8: done: 0.013939 sec","job_status":"done","queue_duration_s":1.569591,"scheduling_latency_s":1.569606,"redis_calls":13,"redis_duration_s":0.0014130000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013939,"completed_at":"2026-08-20T05:57:09.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 253.090352] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd2244f6981ad40b59da1cfc","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd2244f6981ad40b59da1cfc: start","job_status":"start","queue_duration_s":1.584638,"scheduling_latency_s":1.584654}1348gitlab # [ 253.102610] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd2244f6981ad40b59da1cfc","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd2244f6981ad40b59da1cfc: done: 0.014251 sec","job_status":"done","queue_duration_s":1.584638,"scheduling_latency_s":1.584654,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014251,"completed_at":"2026-08-20T05:57:09.716Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 253.141118] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb4e0eb2bfe3ece82f6769b2","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb4e0eb2bfe3ece82f6769b2: start","job_status":"start","queue_duration_s":1.600106,"scheduling_latency_s":1.600123}1350gitlab # [ 253.153241] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb4e0eb2bfe3ece82f6769b2","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb4e0eb2bfe3ece82f6769b2: done: 0.014135 sec","job_status":"done","queue_duration_s":1.600106,"scheduling_latency_s":1.600123,"redis_calls":13,"redis_duration_s":0.0016870000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000759,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014135,"completed_at":"2026-08-20T05:57:09.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 253.192934] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f99324690c0e1ef995fbd35","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f99324690c0e1ef995fbd35: start","job_status":"start","queue_duration_s":1.615416,"scheduling_latency_s":1.615433}1352gitlab # [ 253.205106] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f99324690c0e1ef995fbd35","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f99324690c0e1ef995fbd35: done: 0.014091 sec","job_status":"done","queue_duration_s":1.615416,"scheduling_latency_s":1.615433,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014091,"completed_at":"2026-08-20T05:57:09.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 253.244092] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1d174727bd5501a76c495ba","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1d174727bd5501a76c495ba: start","job_status":"start","queue_duration_s":1.630915,"scheduling_latency_s":1.630932}1354gitlab # [ 253.256837] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1d174727bd5501a76c495ba","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1d174727bd5501a76c495ba: done: 0.01393 sec","job_status":"done","queue_duration_s":1.630915,"scheduling_latency_s":1.630932,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01393,"completed_at":"2026-08-20T05:57:09.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 253.297762] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ed7ecda47f86c9eeaf65eaa","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ed7ecda47f86c9eeaf65eaa: start","job_status":"start","queue_duration_s":1.646686,"scheduling_latency_s":1.646703}1356gitlab # [ 253.310234] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ed7ecda47f86c9eeaf65eaa","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ed7ecda47f86c9eeaf65eaa: done: 0.014636 sec","job_status":"done","queue_duration_s":1.646686,"scheduling_latency_s":1.646703,"redis_calls":13,"redis_duration_s":0.0015990000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014636,"completed_at":"2026-08-20T05:57:09.778Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 253.349356] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20572a0500589ea7bdbb042b","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20572a0500589ea7bdbb042b: start","job_status":"start","queue_duration_s":1.662641,"scheduling_latency_s":1.662659}1358gitlab # [ 253.361817] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20572a0500589ea7bdbb042b","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20572a0500589ea7bdbb042b: done: 0.014935 sec","job_status":"done","queue_duration_s":1.662641,"scheduling_latency_s":1.662659,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014935,"completed_at":"2026-08-20T05:57:09.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 253.402115] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4c217f8cc05f8e35d538527","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4c217f8cc05f8e35d538527: start","job_status":"start","queue_duration_s":1.678763,"scheduling_latency_s":1.67878}1360gitlab # [ 253.414356] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4c217f8cc05f8e35d538527","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4c217f8cc05f8e35d538527: done: 0.013881 sec","job_status":"done","queue_duration_s":1.678763,"scheduling_latency_s":1.67878,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013881,"completed_at":"2026-08-20T05:57:09.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 253.453729] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01992717174b918520de263","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01992717174b918520de263: start","job_status":"start","queue_duration_s":1.694109,"scheduling_latency_s":1.694125}1362gitlab # [ 253.466198] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01992717174b918520de263","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01992717174b918520de263: done: 0.014008 sec","job_status":"done","queue_duration_s":1.694109,"scheduling_latency_s":1.694125,"redis_calls":13,"redis_duration_s":0.0014980000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014008,"completed_at":"2026-08-20T05:57:09.825Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 253.505306] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87c4dbb5b68b32a1a8ab62cc","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87c4dbb5b68b32a1a8ab62cc: start","job_status":"start","queue_duration_s":1.709257,"scheduling_latency_s":1.709273}1364gitlab # [ 253.517778] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87c4dbb5b68b32a1a8ab62cc","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87c4dbb5b68b32a1a8ab62cc: done: 0.014913 sec","job_status":"done","queue_duration_s":1.709257,"scheduling_latency_s":1.709273,"redis_calls":13,"redis_duration_s":0.001533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014913,"completed_at":"2026-08-20T05:57:09.841Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 253.557001] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f1001e8eed7d9644e042545","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f1001e8eed7d9644e042545: start","job_status":"start","queue_duration_s":1.725326,"scheduling_latency_s":1.725343}1366gitlab # [ 253.569140] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f1001e8eed7d9644e042545","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f1001e8eed7d9644e042545: done: 0.014076 sec","job_status":"done","queue_duration_s":1.725326,"scheduling_latency_s":1.725343,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014076,"completed_at":"2026-08-20T05:57:09.856Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 253.609718] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47035ad9275e763bcd2ae887","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47035ad9275e763bcd2ae887: start","job_status":"start","queue_duration_s":1.740571,"scheduling_latency_s":1.740588}1368gitlab # [ 253.622210] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47035ad9275e763bcd2ae887","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47035ad9275e763bcd2ae887: done: 0.014511 sec","job_status":"done","queue_duration_s":1.740571,"scheduling_latency_s":1.740588,"redis_calls":13,"redis_duration_s":0.00154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014511,"completed_at":"2026-08-20T05:57:09.872Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 253.661649] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4774b934ca7245db9f076fc2","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4774b934ca7245db9f076fc2: start","job_status":"start","queue_duration_s":1.756328,"scheduling_latency_s":1.756345}1370gitlab # [ 253.674342] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4774b934ca7245db9f076fc2","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4774b934ca7245db9f076fc2: done: 0.014139 sec","job_status":"done","queue_duration_s":1.756328,"scheduling_latency_s":1.756345,"redis_calls":13,"redis_duration_s":0.001449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014139,"completed_at":"2026-08-20T05:57:09.888Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 253.713565] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99f93ee5978da0e199dd1eb2","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99f93ee5978da0e199dd1eb2: start","job_status":"start","queue_duration_s":1.771613,"scheduling_latency_s":1.771629}1372gitlab # [ 253.726388] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99f93ee5978da0e199dd1eb2","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99f93ee5978da0e199dd1eb2: done: 0.01389 sec","job_status":"done","queue_duration_s":1.771613,"scheduling_latency_s":1.771629,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01389,"completed_at":"2026-08-20T05:57:09.903Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 253.765803] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32e7d2e28797f95fa4a144a3","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32e7d2e28797f95fa4a144a3: start","job_status":"start","queue_duration_s":1.786864,"scheduling_latency_s":1.78688}1374gitlab # [ 253.778281] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32e7d2e28797f95fa4a144a3","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32e7d2e28797f95fa4a144a3: done: 0.028271 sec","job_status":"done","queue_duration_s":1.786864,"scheduling_latency_s":1.78688,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028271,"completed_at":"2026-08-20T05:57:09.932Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 253.818993] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d4d2aa0b053c03cc4d8ecfb","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d4d2aa0b053c03cc4d8ecfb: start","job_status":"start","queue_duration_s":1.816357,"scheduling_latency_s":1.816374}1376gitlab # [ 253.831445] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d4d2aa0b053c03cc4d8ecfb","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d4d2aa0b053c03cc4d8ecfb: done: 0.016648 sec","job_status":"done","queue_duration_s":1.816357,"scheduling_latency_s":1.816374,"redis_calls":13,"redis_duration_s":0.0020889999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001511,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016648,"completed_at":"2026-08-20T05:57:09.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 253.871532] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9deaaa7861091f85403893ba","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9deaaa7861091f85403893ba: start","job_status":"start","queue_duration_s":1.834264,"scheduling_latency_s":1.834284}1378gitlab # [ 253.884208] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:57:09.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9deaaa7861091f85403893ba","created_at":"2026-08-20T05:57:08.035Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-bfe80faba618414c","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"23804ab607733840e9e73450122ef23e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:08.117Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9deaaa7861091f85403893ba: done: 0.018534 sec","job_status":"done","queue_duration_s":1.834264,"scheduling_latency_s":1.834284,"redis_calls":13,"redis_duration_s":0.001856,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001217,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018534,"completed_at":"2026-08-20T05:57:09.970Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 289.000709] setup-gitlab-start[3055]: W, [2026-08-20T05:57:46.875202 #3055] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1380gitlab # [ 307.775953] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:05.649Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9c42221f7eff9d79d6cb5a52","created_at":"2026-08-20T05:58:05.621Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6431fd5a4b6a75d2764fbbc7c10b1f33","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.641Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9c42221f7eff9d79d6cb5a52: start","job_status":"start","queue_duration_s":0.00837,"scheduling_latency_s":0.008429}1381gitlab # [ 308.002625] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:05.877Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9c42221f7eff9d79d6cb5a52","created_at":"2026-08-20T05:58:05.621Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6431fd5a4b6a75d2764fbbc7c10b1f33","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.641Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9c42221f7eff9d79d6cb5a52: done: 0.227666 sec","job_status":"done","queue_duration_s":0.00837,"scheduling_latency_s":0.008429,"redis_calls":15,"redis_duration_s":0.048905000000000004,"redis_read_bytes":1029,"redis_write_bytes":1194,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.029162,"redis_feature_flag_read_bytes":1024,"redis_feature_flag_write_bytes":513,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.016768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002975,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.227666,"completed_at":"2026-08-20T05:58:05.876Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008002,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 308.098341] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:05.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4be71e9841e15d351d2ce4d6","created_at":"2026-08-20T05:58:05.674Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66c41cb5ad1564846b46f9304128bc20","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.682Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4be71e9841e15d351d2ce4d6: start","job_status":"start","queue_duration_s":0.238967,"scheduling_latency_s":0.239028}1383gitlab # [ 308.120245] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:05.975Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1384gitlab # [ 308.137055] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4be71e9841e15d351d2ce4d6","created_at":"2026-08-20T05:58:05.674Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66c41cb5ad1564846b46f9304128bc20","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.682Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4be71e9841e15d351d2ce4d6: done: 0.090306 sec","job_status":"done","queue_duration_s":0.238967,"scheduling_latency_s":0.239028,"redis_calls":7,"redis_duration_s":0.011734999999999999,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004985,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090306,"completed_at":"2026-08-20T05:58:06.011Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 308.201176] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d7c185c31cd96258924fcff6","created_at":"2026-08-20T05:58:05.736Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28b80e21df1dabf9218a942e43546fd0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.741Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d7c185c31cd96258924fcff6: start","job_status":"start","queue_duration_s":0.283617,"scheduling_latency_s":0.283683}1386gitlab # [ 308.315938] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d7c185c31cd96258924fcff6","created_at":"2026-08-20T05:58:05.736Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28b80e21df1dabf9218a942e43546fd0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.741Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d7c185c31cd96258924fcff6: done: 0.16511 sec","job_status":"done","queue_duration_s":0.283617,"scheduling_latency_s":0.283683,"redis_calls":9,"redis_duration_s":0.013754,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006668,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007086,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0036635,"exclusive_lock_hold_duration_s":0.00875774,"duration_s":0.16511,"completed_at":"2026-08-20T05:58:06.190Z","load_balancing_strategy":"primary","db_duration_s":0.002909,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 308.401701] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.236Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a2ae117166d6ca299379b5aa","created_at":"2026-08-20T05:58:05.766Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e558bd94c24b0bf5d7731ec2cd4b963","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.778Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a2ae117166d6ca299379b5aa: start","job_status":"start","queue_duration_s":0.458537,"scheduling_latency_s":0.458595}1388gitlab # [ 308.516191] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a2ae117166d6ca299379b5aa","created_at":"2026-08-20T05:58:05.766Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e558bd94c24b0bf5d7731ec2cd4b963","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.778Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a2ae117166d6ca299379b5aa: done: 0.154133 sec","job_status":"done","queue_duration_s":0.458537,"scheduling_latency_s":0.458595,"redis_calls":9,"redis_duration_s":0.014588,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011989,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002599,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00169672,"exclusive_lock_hold_duration_s":0.00575774,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.154133,"completed_at":"2026-08-20T05:58:06.390Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 308.608613] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.394Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e0eb7520d383ec9529891be3","created_at":"2026-08-20T05:58:05.804Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab0c592cfe3ac0560cf7a79b2b2f6fdf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.823Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e0eb7520d383ec9529891be3: start","job_status":"start","queue_duration_s":0.570615,"scheduling_latency_s":0.570661}1390gitlab # [ 308.626429] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.441Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e0eb7520d383ec9529891be3","created_at":"2026-08-20T05:58:05.804Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab0c592cfe3ac0560cf7a79b2b2f6fdf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.823Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e0eb7520d383ec9529891be3: done: 0.047405 sec","job_status":"done","queue_duration_s":0.570615,"scheduling_latency_s":0.570661,"redis_calls":8,"redis_duration_s":0.003092,"redis_read_bytes":133,"redis_write_bytes":769,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000322,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":58,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00081,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047405,"completed_at":"2026-08-20T05:58:06.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 308.671784] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"32b44dff95246fa7036d28ac","created_at":"2026-08-20T05:58:05.851Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5150f3a3aa1261ffe6cc46ea1fbeab43","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.869Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-32b44dff95246fa7036d28ac: start","job_status":"start","queue_duration_s":0.578651,"scheduling_latency_s":0.578695}1392gitlab # [ 308.685914] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.548Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"32b44dff95246fa7036d28ac","created_at":"2026-08-20T05:58:05.851Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5150f3a3aa1261ffe6cc46ea1fbeab43","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.869Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-32b44dff95246fa7036d28ac: done: 0.101103 sec","job_status":"done","queue_duration_s":0.578651,"scheduling_latency_s":0.578695,"redis_calls":14,"redis_duration_s":0.005286,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.00063,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003536,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00112,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.101103,"completed_at":"2026-08-20T05:58:06.548Z","load_balancing_strategy":"primary","db_duration_s":0.021111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 308.730562] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.551Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d0c317d4fff4b2351e4ffd27","created_at":"2026-08-20T05:58:05.882Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"741915b3dc23fc7a9a7797c1302e5775","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.894Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d0c317d4fff4b2351e4ffd27: start","job_status":"start","queue_duration_s":0.656344,"scheduling_latency_s":0.656375}1394gitlab # [ 308.746487] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.572Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d0c317d4fff4b2351e4ffd27","created_at":"2026-08-20T05:58:05.882Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"741915b3dc23fc7a9a7797c1302e5775","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.894Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d0c317d4fff4b2351e4ffd27: done: 0.021737 sec","job_status":"done","queue_duration_s":0.656344,"scheduling_latency_s":0.656375,"redis_calls":8,"redis_duration_s":0.002278,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001399,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0006,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021737,"completed_at":"2026-08-20T05:58:06.572Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 308.791732] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1a90e48197f72430494f6b27","created_at":"2026-08-20T05:58:05.918Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"808fa81e58eb8180feed7a13b9902293","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.931Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1a90e48197f72430494f6b27: start","job_status":"start","queue_duration_s":0.643441,"scheduling_latency_s":0.643466}1396gitlab # [ 308.807183] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.591Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1a90e48197f72430494f6b27","created_at":"2026-08-20T05:58:05.918Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"808fa81e58eb8180feed7a13b9902293","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:05.931Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1a90e48197f72430494f6b27: done: 0.016921 sec","job_status":"done","queue_duration_s":0.643441,"scheduling_latency_s":0.643466,"redis_calls":7,"redis_duration_s":0.001836,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001326,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016921,"completed_at":"2026-08-20T05:58:06.591Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 308.849473] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fcde586c2174ae719dd79f3a","created_at":"2026-08-20T05:58:05.939Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0d96424575cc700e79ae7cc9fbde03c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:58:05.945Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fcde586c2174ae719dd79f3a: start","job_status":"start","queue_duration_s":0.647604,"scheduling_latency_s":0.647628}1398gitlab # [ 308.863520] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.603Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1399gitlab # [ 308.867158] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fcde586c2174ae719dd79f3a","created_at":"2026-08-20T05:58:05.939Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0d96424575cc700e79ae7cc9fbde03c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:58:05.945Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fcde586c2174ae719dd79f3a: done: 0.016085 sec","job_status":"done","queue_duration_s":0.647604,"scheduling_latency_s":0.647628,"redis_calls":7,"redis_duration_s":0.00242,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016085,"completed_at":"2026-08-20T05:58:06.609Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 308.909812] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.611Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"576d8c24748aabe9c9ecac55","created_at":"2026-08-20T05:58:05.989Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c86f9b8b12a7adc2424c59cd4046c70f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.006Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-576d8c24748aabe9c9ecac55: start","job_status":"start","queue_duration_s":0.605376,"scheduling_latency_s":0.6054}1401gitlab # [ 308.925192] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"576d8c24748aabe9c9ecac55","created_at":"2026-08-20T05:58:05.989Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c86f9b8b12a7adc2424c59cd4046c70f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.006Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-576d8c24748aabe9c9ecac55: done: 0.057845 sec","job_status":"done","queue_duration_s":0.605376,"scheduling_latency_s":0.6054,"redis_calls":9,"redis_duration_s":0.003171,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001557,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001614,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00100488,"exclusive_lock_hold_duration_s":0.02773348,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.057845,"completed_at":"2026-08-20T05:58:06.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 308.970683] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"47858a94413fc9fa289a2c03","created_at":"2026-08-20T05:58:06.033Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"610975a31d202bd5ce199de4f8eda68d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.048Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-47858a94413fc9fa289a2c03: start","job_status":"start","queue_duration_s":0.623138,"scheduling_latency_s":0.623166}1403gitlab # [ 308.986180] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"47858a94413fc9fa289a2c03","created_at":"2026-08-20T05:58:06.033Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"610975a31d202bd5ce199de4f8eda68d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.048Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-47858a94413fc9fa289a2c03: done: 0.039594 sec","job_status":"done","queue_duration_s":0.623138,"scheduling_latency_s":0.623166,"redis_calls":7,"redis_duration_s":0.002572,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001874,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000698,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.039594,"completed_at":"2026-08-20T05:58:06.711Z","load_balancing_strategy":"primary","db_duration_s":0.016896,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 309.030080] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.713Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fe89722b9a7b2cdac263aff8","created_at":"2026-08-20T05:58:06.056Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8393a8ac7ff258e83c179a275ab59790","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:58:06.062Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fe89722b9a7b2cdac263aff8: start","job_status":"start","queue_duration_s":0.650618,"scheduling_latency_s":0.650647}1405gitlab # [ 309.043826] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.746Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fe89722b9a7b2cdac263aff8","created_at":"2026-08-20T05:58:06.056Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8393a8ac7ff258e83c179a275ab59790","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:58:06.062Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fe89722b9a7b2cdac263aff8: done: 0.032972 sec","job_status":"done","queue_duration_s":0.650618,"scheduling_latency_s":0.650647,"redis_calls":7,"redis_duration_s":0.002295,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000615,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032972,"completed_at":"2026-08-20T05:58:06.746Z","load_balancing_strategy":"primary","db_duration_s":0.003351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 309.085289] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bac2628b2971193454d080ff","created_at":"2026-08-20T05:58:06.067Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"314a68387242a133cb243520835d380b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:58:06.077Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bac2628b2971193454d080ff: start","job_status":"start","queue_duration_s":0.670953,"scheduling_latency_s":0.670982}1407gitlab # [ 309.099128] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.762Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1408gitlab # [ 309.103164] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.776Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bac2628b2971193454d080ff","created_at":"2026-08-20T05:58:06.067Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"314a68387242a133cb243520835d380b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:58:06.077Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bac2628b2971193454d080ff: done: 0.027577 sec","job_status":"done","queue_duration_s":0.670953,"scheduling_latency_s":0.670982,"redis_calls":7,"redis_duration_s":0.002968,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002337,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000631,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027577,"completed_at":"2026-08-20T05:58:06.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 309.145636] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.779Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"417926073d3f3386c5c765c3","created_at":"2026-08-20T05:58:06.112Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.115Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-417926073d3f3386c5c765c3: start","job_status":"start","queue_duration_s":0.663622,"scheduling_latency_s":0.663666}1410gitlab # [ 309.159494] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"417926073d3f3386c5c765c3","created_at":"2026-08-20T05:58:06.112Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.115Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-417926073d3f3386c5c765c3: done: 0.145031 sec","job_status":"done","queue_duration_s":0.663622,"scheduling_latency_s":0.663666,"redis_calls":60,"redis_duration_s":0.019234,"redis_read_bytes":108,"redis_write_bytes":40909,"redis_queues_calls":2,"redis_queues_duration_s":0.000901,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37285,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.01738,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.145031,"completed_at":"2026-08-20T05:58:06.924Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 309.203115] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:06.926Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d1d844786bc535612d2aadfa","created_at":"2026-08-20T05:58:06.121Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18f47845ba6ae7259d9bbd300fb2b350","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.126Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d1d844786bc535612d2aadfa: start","job_status":"start","queue_duration_s":0.800008,"scheduling_latency_s":0.800035}1412gitlab # [ 309.386745] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.261Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d1d844786bc535612d2aadfa","created_at":"2026-08-20T05:58:06.121Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18f47845ba6ae7259d9bbd300fb2b350","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.126Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d1d844786bc535612d2aadfa: done: 0.335452 sec","job_status":"done","queue_duration_s":0.800008,"scheduling_latency_s":0.800035,"redis_calls":11,"redis_duration_s":0.00366,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000647,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001489,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.057,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.259195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00076178,"exclusive_lock_hold_duration_s":0.31065338,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.335452,"completed_at":"2026-08-20T05:58:07.261Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.091944,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 309.478688] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"16faf08bd651c47ad52c6202","created_at":"2026-08-20T05:58:06.155Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4fe22bc362e018c0f4b08d65ce0c97a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.161Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-16faf08bd651c47ad52c6202: start","job_status":"start","queue_duration_s":1.102857,"scheduling_latency_s":1.102886}1414gitlab # [ 309.543408] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.417Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"16faf08bd651c47ad52c6202","created_at":"2026-08-20T05:58:06.155Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4fe22bc362e018c0f4b08d65ce0c97a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.161Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-16faf08bd651c47ad52c6202: done: 0.153904 sec","job_status":"done","queue_duration_s":1.102857,"scheduling_latency_s":1.102886,"redis_calls":9,"redis_duration_s":0.004366,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002003,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002363,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.034,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00083116,"exclusive_lock_hold_duration_s":0.12525876,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.153904,"completed_at":"2026-08-20T05:58:07.417Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.108357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 309.633126] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.422Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1f411804658a28bc2523c434","created_at":"2026-08-20T05:58:06.181Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b7ca030db6d2b6e16d75a8f412eadcf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.185Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1f411804658a28bc2523c434: start","job_status":"start","queue_duration_s":1.236034,"scheduling_latency_s":1.236082}1416gitlab # [ 309.650492] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.441Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1417gitlab # [ 309.654059] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.451Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1f411804658a28bc2523c434","created_at":"2026-08-20T05:58:06.181Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b7ca030db6d2b6e16d75a8f412eadcf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.185Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1f411804658a28bc2523c434: done: 0.029985 sec","job_status":"done","queue_duration_s":1.236034,"scheduling_latency_s":1.236082,"redis_calls":8,"redis_duration_s":0.002823,"redis_read_bytes":133,"redis_write_bytes":900,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000371,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":129,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00181,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000642,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029985,"completed_at":"2026-08-20T05:58:07.451Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 309.697457] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.454Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"ff2202b1a35d50fe9e6d7f5a","created_at":"2026-08-20T05:58:06.204Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"134f1b0ef73db0c4b35cb81b6850bd9d","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.215Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-ff2202b1a35d50fe9e6d7f5a: start","job_status":"start","queue_duration_s":1.238577,"scheduling_latency_s":1.238608}1419gitlab # [ 309.711051] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.484Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"ff2202b1a35d50fe9e6d7f5a","created_at":"2026-08-20T05:58:06.204Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"134f1b0ef73db0c4b35cb81b6850bd9d","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.215Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-ff2202b1a35d50fe9e6d7f5a: done: 0.030181 sec","job_status":"done","queue_duration_s":1.238577,"scheduling_latency_s":1.238608,"redis_calls":12,"redis_duration_s":0.003667,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00074,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000629,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004445,"duration_s":0.030181,"completed_at":"2026-08-20T05:58:07.484Z","load_balancing_strategy":"primary","db_duration_s":0.00072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 309.755977] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.486Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"843f6c58a6c3bc312cdf7e85","created_at":"2026-08-20T05:58:06.229Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f13f9fc1d9ad03bf781b410d022adfa","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.241Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-843f6c58a6c3bc312cdf7e85: start","job_status":"start","queue_duration_s":1.244516,"scheduling_latency_s":1.244541}1421gitlab # [ 309.770620] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"843f6c58a6c3bc312cdf7e85","created_at":"2026-08-20T05:58:06.229Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f13f9fc1d9ad03bf781b410d022adfa","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.241Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-843f6c58a6c3bc312cdf7e85: done: 0.033673 sec","job_status":"done","queue_duration_s":1.244516,"scheduling_latency_s":1.244541,"redis_calls":12,"redis_duration_s":0.005585,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000623,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002794,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000728,"exclusive_lock_hold_duration_s":0.0072406200000000006,"duration_s":0.033673,"completed_at":"2026-08-20T05:58:07.519Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 309.814767] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"84053d1b976111750ee506cf","created_at":"2026-08-20T05:58:06.247Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1cea6040e090e439179fc7f2a984148","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.251Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-84053d1b976111750ee506cf: start","job_status":"start","queue_duration_s":1.270545,"scheduling_latency_s":1.270568}1423gitlab # [ 309.829734] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.531Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1424gitlab # [ 309.833090] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"84053d1b976111750ee506cf","created_at":"2026-08-20T05:58:06.247Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1cea6040e090e439179fc7f2a984148","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.251Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-84053d1b976111750ee506cf: done: 0.016512 sec","job_status":"done","queue_duration_s":1.270545,"scheduling_latency_s":1.270568,"redis_calls":8,"redis_duration_s":0.002006,"redis_read_bytes":133,"redis_write_bytes":964,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":138,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016512,"completed_at":"2026-08-20T05:58:07.538Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 309.876223] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"14622a486aa8e252f18f2f6a","created_at":"2026-08-20T05:58:06.275Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e17a26e82a2718b325edef2839f9e774","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.279Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-14622a486aa8e252f18f2f6a: start","job_status":"start","queue_duration_s":1.260545,"scheduling_latency_s":1.260568}1426gitlab # [ 309.890985] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.549Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1427gitlab # [ 309.894915] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"14622a486aa8e252f18f2f6a","created_at":"2026-08-20T05:58:06.275Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e17a26e82a2718b325edef2839f9e774","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.279Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-14622a486aa8e252f18f2f6a: done: 0.015868 sec","job_status":"done","queue_duration_s":1.260545,"scheduling_latency_s":1.260568,"redis_calls":8,"redis_duration_s":0.001973,"redis_read_bytes":133,"redis_write_bytes":958,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":137,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015868,"completed_at":"2026-08-20T05:58:07.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 309.939252] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"464a9fcb94566d9194bebb74","created_at":"2026-08-20T05:58:06.282Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73c469f7be4e140d1c80d8cd7887248d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.290Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-464a9fcb94566d9194bebb74: start","job_status":"start","queue_duration_s":1.267098,"scheduling_latency_s":1.267118}1429gitlab # [ 309.954226] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"464a9fcb94566d9194bebb74","created_at":"2026-08-20T05:58:06.282Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73c469f7be4e140d1c80d8cd7887248d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.290Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-464a9fcb94566d9194bebb74: done: 0.028335 sec","job_status":"done","queue_duration_s":1.267098,"scheduling_latency_s":1.267118,"redis_calls":10,"redis_duration_s":0.002465,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000489,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035078,"duration_s":0.028335,"completed_at":"2026-08-20T05:58:07.585Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 309.997309] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.587Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"909a6ad22a2411a49f159a9f","created_at":"2026-08-20T05:58:06.301Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e09115884569ce1c2334e7f3dd2881c9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.305Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-909a6ad22a2411a49f159a9f: start","job_status":"start","queue_duration_s":1.281638,"scheduling_latency_s":1.281658}1431gitlab # [ 310.012287] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"909a6ad22a2411a49f159a9f","created_at":"2026-08-20T05:58:06.301Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e09115884569ce1c2334e7f3dd2881c9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.305Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-909a6ad22a2411a49f159a9f: done: 0.023007 sec","job_status":"done","queue_duration_s":1.281638,"scheduling_latency_s":1.281658,"redis_calls":11,"redis_duration_s":0.002839,"redis_read_bytes":136,"redis_write_bytes":1366,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":127,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001503,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0052242,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.023007,"completed_at":"2026-08-20T05:58:07.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002267,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1432gitlab # [ 310.057752] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"37135ae258ab996a26986614","created_at":"2026-08-20T05:58:06.335Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9bef41a775c095cd398c724ceba38a15","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.339Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-37135ae258ab996a26986614: start","job_status":"start","queue_duration_s":1.272567,"scheduling_latency_s":1.272587}1433gitlab # [ 310.072386] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"37135ae258ab996a26986614","created_at":"2026-08-20T05:58:06.335Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-38767caca46148d2","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9bef41a775c095cd398c724ceba38a15","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.339Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-37135ae258ab996a26986614: done: 0.312272 sec","job_status":"done","queue_duration_s":1.272567,"scheduling_latency_s":1.272587,"redis_calls":562,"redis_duration_s":0.060985000000000004,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001189,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.059796,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.286799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.312272,"completed_at":"2026-08-20T05:58:07.924Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 310.114172] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.926Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a025f37041aaa4533d677506","created_at":"2026-08-20T05:58:06.469Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e2bef5b665794606","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5150f3a3aa1261ffe6cc46ea1fbeab43","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.538Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a025f37041aaa4533d677506: start","job_status":"start","queue_duration_s":1.387288,"scheduling_latency_s":1.387312}1435gitlab # [ 310.126953] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.939Z","message":"No existing merge request to be cleaned up."}1436gitlab # [ 310.128685] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.948Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a025f37041aaa4533d677506","created_at":"2026-08-20T05:58:06.469Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e2bef5b665794606","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5150f3a3aa1261ffe6cc46ea1fbeab43","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.538Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a025f37041aaa4533d677506: done: 0.02279 sec","job_status":"done","queue_duration_s":1.387288,"scheduling_latency_s":1.387312,"redis_calls":11,"redis_duration_s":0.002069,"redis_read_bytes":136,"redis_write_bytes":1131,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000184,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":109,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02279,"completed_at":"2026-08-20T05:58:07.948Z","load_balancing_strategy":"primary","db_duration_s":0.002277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 310.171788] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.950Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"776763537c7b03d61d455e9f","created_at":"2026-08-20T05:58:06.469Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e2bef5b665794606","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5150f3a3aa1261ffe6cc46ea1fbeab43","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.538Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-776763537c7b03d61d455e9f: start","job_status":"start","queue_duration_s":1.411472,"scheduling_latency_s":1.411491}1438gitlab # [ 310.184769] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.962Z","message":"No existing merge request to be cleaned up."}1439gitlab # [ 310.186452] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.971Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"776763537c7b03d61d455e9f","created_at":"2026-08-20T05:58:06.469Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e2bef5b665794606","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5150f3a3aa1261ffe6cc46ea1fbeab43","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.538Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-776763537c7b03d61d455e9f: done: 0.021669 sec","job_status":"done","queue_duration_s":1.411472,"scheduling_latency_s":1.411491,"redis_calls":10,"redis_duration_s":0.0022040000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001253,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021669,"completed_at":"2026-08-20T05:58:07.971Z","load_balancing_strategy":"primary","db_duration_s":0.001621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 310.226405] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.973Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8d62a35a7d994f91e9b56991","created_at":"2026-08-20T05:58:06.469Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e2bef5b665794606","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5150f3a3aa1261ffe6cc46ea1fbeab43","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.538Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8d62a35a7d994f91e9b56991: start","job_status":"start","queue_duration_s":1.434721,"scheduling_latency_s":1.434739}1441gitlab # [ 310.239311] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.985Z","message":"No existing merge request to be cleaned up."}1442gitlab # [ 310.241426] redis[780]: 10 changes in 300 seconds. Saving...1443gitlab # [ 310.242454] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.994Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8d62a35a7d994f91e9b56991","created_at":"2026-08-20T05:58:06.469Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e2bef5b665794606","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5150f3a3aa1261ffe6cc46ea1fbeab43","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.538Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8d62a35a7d994f91e9b56991: done: 0.020616 sec","job_status":"done","queue_duration_s":1.434721,"scheduling_latency_s":1.434739,"redis_calls":10,"redis_duration_s":0.0023959999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001416,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020616,"completed_at":"2026-08-20T05:58:07.993Z","load_balancing_strategy":"primary","db_duration_s":0.001678,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 310.283038] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:07.995Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f227ff66e6e1b843ff004dbb","created_at":"2026-08-20T05:58:06.469Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e2bef5b665794606","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5150f3a3aa1261ffe6cc46ea1fbeab43","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.538Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f227ff66e6e1b843ff004dbb: start","job_status":"start","queue_duration_s":1.456816,"scheduling_latency_s":1.456834}1445gitlab # [ 310.296096] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.007Z","message":"No existing merge request to be cleaned up."}1446gitlab # [ 310.297843] redis[780]: Background saving started by pid 33341447gitlab # [ 310.298828] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.024Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f227ff66e6e1b843ff004dbb","created_at":"2026-08-20T05:58:06.469Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-e2bef5b665794606","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5150f3a3aa1261ffe6cc46ea1fbeab43","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.538Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f227ff66e6e1b843ff004dbb: done: 0.028579 sec","job_status":"done","queue_duration_s":1.456816,"scheduling_latency_s":1.456834,"redis_calls":10,"redis_duration_s":0.009718999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00151,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.008209,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028579,"completed_at":"2026-08-20T05:58:08.024Z","load_balancing_strategy":"primary","db_duration_s":0.001503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 310.339011] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de9a1f310462d20df4b82a17","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de9a1f310462d20df4b82a17: start","job_status":"start","queue_duration_s":1.111304,"scheduling_latency_s":1.111325}1449gitlab # [ 310.353103] redis[3334]: BGSAVE done, 468 keys saved, 0 keys skipped, 121555 bytes written.1450gitlab # [ 310.354345] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de9a1f310462d20df4b82a17","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de9a1f310462d20df4b82a17: done: 0.021631 sec","job_status":"done","queue_duration_s":1.111304,"scheduling_latency_s":1.111325,"redis_calls":16,"redis_duration_s":0.003947,"redis_read_bytes":394,"redis_write_bytes":1341,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000654,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":184,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001043,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00225,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021631,"completed_at":"2026-08-20T05:58:08.048Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 310.396823] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"098cecce3a35cb53cc40630a","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-098cecce3a35cb53cc40630a: start","job_status":"start","queue_duration_s":1.134398,"scheduling_latency_s":1.134415}1452gitlab # [ 310.409707] redis[3334]: DB saved on disk1453gitlab # [ 310.410461] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"098cecce3a35cb53cc40630a","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-098cecce3a35cb53cc40630a: done: 0.017251 sec","job_status":"done","queue_duration_s":1.134398,"scheduling_latency_s":1.134415,"redis_calls":14,"redis_duration_s":0.002998,"redis_read_bytes":138,"redis_write_bytes":1269,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":112,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001764,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017251,"completed_at":"2026-08-20T05:58:08.067Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 310.452692] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb927d236204b206538cbb9b","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb927d236204b206538cbb9b: start","job_status":"start","queue_duration_s":1.153158,"scheduling_latency_s":1.153177}1455gitlab # [ 310.465534] redis[3334]: Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB1456gitlab # [ 310.466668] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb927d236204b206538cbb9b","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb927d236204b206538cbb9b: done: 0.017543 sec","job_status":"done","queue_duration_s":1.153158,"scheduling_latency_s":1.153177,"redis_calls":13,"redis_duration_s":0.003783,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017543,"completed_at":"2026-08-20T05:58:08.086Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 310.507524] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"680a1fad4a4a57cb5140822c","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-680a1fad4a4a57cb5140822c: start","job_status":"start","queue_duration_s":1.172267,"scheduling_latency_s":1.172284}1458gitlab # [ 310.520693] redis[780]: Background saving terminated with success1459gitlab # [ 310.521697] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"680a1fad4a4a57cb5140822c","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-680a1fad4a4a57cb5140822c: done: 0.01849 sec","job_status":"done","queue_duration_s":1.172267,"scheduling_latency_s":1.172284,"redis_calls":13,"redis_duration_s":0.002808,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001845,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01849,"completed_at":"2026-08-20T05:58:08.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 310.563132] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90a3d4a080155a02785d6416","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90a3d4a080155a02785d6416: start","job_status":"start","queue_duration_s":1.192247,"scheduling_latency_s":1.192265}1461gitlab # [ 310.576249] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90a3d4a080155a02785d6416","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90a3d4a080155a02785d6416: done: 0.027429 sec","job_status":"done","queue_duration_s":1.192247,"scheduling_latency_s":1.192265,"redis_calls":13,"redis_duration_s":0.012896,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011854,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027429,"completed_at":"2026-08-20T05:58:08.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 310.616894] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85c504a4f808a049573376dc","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85c504a4f808a049573376dc: start","job_status":"start","queue_duration_s":1.221401,"scheduling_latency_s":1.221421}1463gitlab # [ 310.629317] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85c504a4f808a049573376dc","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85c504a4f808a049573376dc: done: 0.01592 sec","job_status":"done","queue_duration_s":1.221401,"scheduling_latency_s":1.221421,"redis_calls":13,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000623,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01592,"completed_at":"2026-08-20T05:58:08.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 310.669853] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09eb62ece1785dfbcb6a2ae9","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09eb62ece1785dfbcb6a2ae9: start","job_status":"start","queue_duration_s":1.240681,"scheduling_latency_s":1.2407}1465gitlab # [ 310.682668] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09eb62ece1785dfbcb6a2ae9","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09eb62ece1785dfbcb6a2ae9: done: 0.016122 sec","job_status":"done","queue_duration_s":1.240681,"scheduling_latency_s":1.2407,"redis_calls":13,"redis_duration_s":0.001738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016122,"completed_at":"2026-08-20T05:58:08.172Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 310.723048] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fce95c19e0c270fdafcea3c","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fce95c19e0c270fdafcea3c: start","job_status":"start","queue_duration_s":1.258032,"scheduling_latency_s":1.25805}1467gitlab # [ 310.735621] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fce95c19e0c270fdafcea3c","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fce95c19e0c270fdafcea3c: done: 0.015694 sec","job_status":"done","queue_duration_s":1.258032,"scheduling_latency_s":1.25805,"redis_calls":13,"redis_duration_s":0.001729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015694,"completed_at":"2026-08-20T05:58:08.189Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 310.776516] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d01eca4229aaf15b182b505","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d01eca4229aaf15b182b505: start","job_status":"start","queue_duration_s":1.274976,"scheduling_latency_s":1.274994}1469gitlab # [ 310.788888] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d01eca4229aaf15b182b505","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d01eca4229aaf15b182b505: done: 0.016176 sec","job_status":"done","queue_duration_s":1.274976,"scheduling_latency_s":1.274994,"redis_calls":13,"redis_duration_s":0.00179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016176,"completed_at":"2026-08-20T05:58:08.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 310.829429] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01f3c21ff7a91d4af0785761","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01f3c21ff7a91d4af0785761: start","job_status":"start","queue_duration_s":1.292431,"scheduling_latency_s":1.29245}1471gitlab # [ 310.842746] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01f3c21ff7a91d4af0785761","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01f3c21ff7a91d4af0785761: done: 0.016542 sec","job_status":"done","queue_duration_s":1.292431,"scheduling_latency_s":1.29245,"redis_calls":13,"redis_duration_s":0.0018410000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001283,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016542,"completed_at":"2026-08-20T05:58:08.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 310.881560] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc50f383b0090b7582dd2a60","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc50f383b0090b7582dd2a60: start","job_status":"start","queue_duration_s":1.310127,"scheduling_latency_s":1.310144}1473gitlab # [ 310.893919] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc50f383b0090b7582dd2a60","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc50f383b0090b7582dd2a60: done: 0.015281 sec","job_status":"done","queue_duration_s":1.310127,"scheduling_latency_s":1.310144,"redis_calls":13,"redis_duration_s":0.0015600000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015281,"completed_at":"2026-08-20T05:58:08.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 310.933171] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70ca73f8ee0216957ace5df4","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70ca73f8ee0216957ace5df4: start","job_status":"start","queue_duration_s":1.326499,"scheduling_latency_s":1.326516}1475gitlab # [ 310.945957] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70ca73f8ee0216957ace5df4","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70ca73f8ee0216957ace5df4: done: 0.015025 sec","job_status":"done","queue_duration_s":1.326499,"scheduling_latency_s":1.326516,"redis_calls":13,"redis_duration_s":0.002448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015025,"completed_at":"2026-08-20T05:58:08.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 310.986217] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca30aa702b0b11e59f7f6b8f","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca30aa702b0b11e59f7f6b8f: start","job_status":"start","queue_duration_s":1.34262,"scheduling_latency_s":1.342637}1477gitlab # [ 310.998527] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca30aa702b0b11e59f7f6b8f","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca30aa702b0b11e59f7f6b8f: done: 0.014946 sec","job_status":"done","queue_duration_s":1.34262,"scheduling_latency_s":1.342637,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014946,"completed_at":"2026-08-20T05:58:08.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 311.037473] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04e62d30d9ce90c9d82f20d6","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04e62d30d9ce90c9d82f20d6: start","job_status":"start","queue_duration_s":1.359845,"scheduling_latency_s":1.359863}1479gitlab # [ 311.049841] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04e62d30d9ce90c9d82f20d6","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04e62d30d9ce90c9d82f20d6: done: 0.015262 sec","job_status":"done","queue_duration_s":1.359845,"scheduling_latency_s":1.359863,"redis_calls":13,"redis_duration_s":0.002594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015262,"completed_at":"2026-08-20T05:58:08.290Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 311.088514] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cae02dd212a4a8f48c10727","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cae02dd212a4a8f48c10727: start","job_status":"start","queue_duration_s":1.376235,"scheduling_latency_s":1.376252}1481gitlab # [ 311.100765] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cae02dd212a4a8f48c10727","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cae02dd212a4a8f48c10727: done: 0.01571 sec","job_status":"done","queue_duration_s":1.376235,"scheduling_latency_s":1.376252,"redis_calls":13,"redis_duration_s":0.001678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01571,"completed_at":"2026-08-20T05:58:08.307Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 311.140181] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8463aab6d1ee583f78c2f239","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8463aab6d1ee583f78c2f239: start","job_status":"start","queue_duration_s":1.393097,"scheduling_latency_s":1.393114}1483gitlab # [ 311.152569] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8463aab6d1ee583f78c2f239","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8463aab6d1ee583f78c2f239: done: 0.015643 sec","job_status":"done","queue_duration_s":1.393097,"scheduling_latency_s":1.393114,"redis_calls":13,"redis_duration_s":0.001787,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001231,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015643,"completed_at":"2026-08-20T05:58:08.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 311.192715] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c2357b19ed43f911ff54424","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c2357b19ed43f911ff54424: start","job_status":"start","queue_duration_s":1.410942,"scheduling_latency_s":1.410959}1485gitlab # [ 311.205126] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c2357b19ed43f911ff54424","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c2357b19ed43f911ff54424: done: 0.015148 sec","job_status":"done","queue_duration_s":1.410942,"scheduling_latency_s":1.410959,"redis_calls":13,"redis_duration_s":0.001537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015148,"completed_at":"2026-08-20T05:58:08.341Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 311.245021] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0d3e3b41b550fb0888b1dd0","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0d3e3b41b550fb0888b1dd0: start","job_status":"start","queue_duration_s":1.42718,"scheduling_latency_s":1.427196}1487gitlab # [ 311.257645] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0d3e3b41b550fb0888b1dd0","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0d3e3b41b550fb0888b1dd0: done: 0.015316 sec","job_status":"done","queue_duration_s":1.42718,"scheduling_latency_s":1.427196,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015316,"completed_at":"2026-08-20T05:58:08.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 311.297095] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d59d087af4d218e5907f8680","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d59d087af4d218e5907f8680: start","job_status":"start","queue_duration_s":1.443614,"scheduling_latency_s":1.443631}1489gitlab # [ 311.309676] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d59d087af4d218e5907f8680","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d59d087af4d218e5907f8680: done: 0.015382 sec","job_status":"done","queue_duration_s":1.443614,"scheduling_latency_s":1.443631,"redis_calls":13,"redis_duration_s":0.0015760000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015382,"completed_at":"2026-08-20T05:58:08.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 311.349383] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d2bbe47250e6536321f7e27","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d2bbe47250e6536321f7e27: start","job_status":"start","queue_duration_s":1.461446,"scheduling_latency_s":1.461465}1491gitlab # [ 311.363390] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d2bbe47250e6536321f7e27","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d2bbe47250e6536321f7e27: done: 0.015558 sec","job_status":"done","queue_duration_s":1.461446,"scheduling_latency_s":1.461465,"redis_calls":13,"redis_duration_s":0.002508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015558,"completed_at":"2026-08-20T05:58:08.392Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 311.403121] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eff2ed140dab0bb1915464b","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eff2ed140dab0bb1915464b: start","job_status":"start","queue_duration_s":1.478092,"scheduling_latency_s":1.478108}1493gitlab # [ 311.415845] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eff2ed140dab0bb1915464b","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eff2ed140dab0bb1915464b: done: 0.015371 sec","job_status":"done","queue_duration_s":1.478092,"scheduling_latency_s":1.478108,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015371,"completed_at":"2026-08-20T05:58:08.409Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 311.455589] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c44a8b01b169239179180bb0","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c44a8b01b169239179180bb0: start","job_status":"start","queue_duration_s":1.494573,"scheduling_latency_s":1.494589}1495gitlab # [ 311.468225] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c44a8b01b169239179180bb0","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c44a8b01b169239179180bb0: done: 0.015624 sec","job_status":"done","queue_duration_s":1.494573,"scheduling_latency_s":1.494589,"redis_calls":13,"redis_duration_s":0.001877,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001307,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015624,"completed_at":"2026-08-20T05:58:08.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 311.507442] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2837a20fef9b5899818c79f5","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2837a20fef9b5899818c79f5: start","job_status":"start","queue_duration_s":1.511315,"scheduling_latency_s":1.511332}1497gitlab # [ 311.520098] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2837a20fef9b5899818c79f5","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2837a20fef9b5899818c79f5: done: 0.015292 sec","job_status":"done","queue_duration_s":1.511315,"scheduling_latency_s":1.511332,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015292,"completed_at":"2026-08-20T05:58:08.442Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 311.560571] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22708d99e8c871cd80204170","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22708d99e8c871cd80204170: start","job_status":"start","queue_duration_s":1.529052,"scheduling_latency_s":1.52907}1499gitlab # [ 311.574018] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22708d99e8c871cd80204170","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22708d99e8c871cd80204170: done: 0.015742 sec","job_status":"done","queue_duration_s":1.529052,"scheduling_latency_s":1.52907,"redis_calls":13,"redis_duration_s":0.0015890000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015742,"completed_at":"2026-08-20T05:58:08.460Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 311.613190] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8072873f8005c50da53eab2","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8072873f8005c50da53eab2: start","job_status":"start","queue_duration_s":1.54591,"scheduling_latency_s":1.545925}1501gitlab # [ 311.626049] postgres[858]: [858] LOG: checkpoint starting: time1502gitlab # [ 311.626912] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8072873f8005c50da53eab2","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8072873f8005c50da53eab2: done: 0.015869 sec","job_status":"done","queue_duration_s":1.54591,"scheduling_latency_s":1.545925,"redis_calls":13,"redis_duration_s":0.001632,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015869,"completed_at":"2026-08-20T05:58:08.477Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 311.666114] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db880a2eb09a19a466d6e4f5","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db880a2eb09a19a466d6e4f5: start","job_status":"start","queue_duration_s":1.562947,"scheduling_latency_s":1.562963}1504gitlab # [ 311.678607] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db880a2eb09a19a466d6e4f5","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db880a2eb09a19a466d6e4f5: done: 0.015561 sec","job_status":"done","queue_duration_s":1.562947,"scheduling_latency_s":1.562963,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015561,"completed_at":"2026-08-20T05:58:08.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 311.718004] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3318399f8026ef256bfa386d","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3318399f8026ef256bfa386d: start","job_status":"start","queue_duration_s":1.57962,"scheduling_latency_s":1.579637}1506gitlab # [ 311.730171] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3318399f8026ef256bfa386d","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3318399f8026ef256bfa386d: done: 0.015089 sec","job_status":"done","queue_duration_s":1.57962,"scheduling_latency_s":1.579637,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015089,"completed_at":"2026-08-20T05:58:08.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 311.770540] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2d755c3e23956806d89f25d","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2d755c3e23956806d89f25d: start","job_status":"start","queue_duration_s":1.596474,"scheduling_latency_s":1.596492}1508gitlab # [ 311.782980] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2d755c3e23956806d89f25d","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2d755c3e23956806d89f25d: done: 0.01544 sec","job_status":"done","queue_duration_s":1.596474,"scheduling_latency_s":1.596492,"redis_calls":13,"redis_duration_s":0.0018419999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001273,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01544,"completed_at":"2026-08-20T05:58:08.527Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 311.822254] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"259e6d248929dd27d5d685c1","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-259e6d248929dd27d5d685c1: start","job_status":"start","queue_duration_s":1.613098,"scheduling_latency_s":1.613115}1510gitlab # [ 311.835055] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"259e6d248929dd27d5d685c1","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-259e6d248929dd27d5d685c1: done: 0.015222 sec","job_status":"done","queue_duration_s":1.613098,"scheduling_latency_s":1.613115,"redis_calls":13,"redis_duration_s":0.001589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015222,"completed_at":"2026-08-20T05:58:08.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 311.874288] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b767b19ea72edc432b287c9","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b767b19ea72edc432b287c9: start","job_status":"start","queue_duration_s":1.629483,"scheduling_latency_s":1.629499}1512gitlab # [ 311.886836] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b767b19ea72edc432b287c9","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b767b19ea72edc432b287c9: done: 0.015154 sec","job_status":"done","queue_duration_s":1.629483,"scheduling_latency_s":1.629499,"redis_calls":13,"redis_duration_s":0.0015760000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015154,"completed_at":"2026-08-20T05:58:08.560Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 311.926307] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"386e8b523a04888704d0dd11","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-386e8b523a04888704d0dd11: start","job_status":"start","queue_duration_s":1.646383,"scheduling_latency_s":1.6464}1514gitlab # [ 311.938784] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"386e8b523a04888704d0dd11","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-386e8b523a04888704d0dd11: done: 0.014954 sec","job_status":"done","queue_duration_s":1.646383,"scheduling_latency_s":1.6464,"redis_calls":13,"redis_duration_s":0.0015539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014954,"completed_at":"2026-08-20T05:58:08.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 311.979363] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc0584c385b1d7f38a37efbe","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc0584c385b1d7f38a37efbe: start","job_status":"start","queue_duration_s":1.66242,"scheduling_latency_s":1.662436}1516gitlab # [ 311.991960] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc0584c385b1d7f38a37efbe","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc0584c385b1d7f38a37efbe: done: 0.014711 sec","job_status":"done","queue_duration_s":1.66242,"scheduling_latency_s":1.662436,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014711,"completed_at":"2026-08-20T05:58:08.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 312.031309] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee7085e9983bbcd109d9743c","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee7085e9983bbcd109d9743c: start","job_status":"start","queue_duration_s":1.678229,"scheduling_latency_s":1.678245}1518gitlab # [ 312.043892] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee7085e9983bbcd109d9743c","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee7085e9983bbcd109d9743c: done: 0.014479 sec","job_status":"done","queue_duration_s":1.678229,"scheduling_latency_s":1.678245,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014479,"completed_at":"2026-08-20T05:58:08.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 312.083979] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"326978a9a1d218e3f69c4e71","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-326978a9a1d218e3f69c4e71: start","job_status":"start","queue_duration_s":1.69385,"scheduling_latency_s":1.693867}1520gitlab # [ 312.096631] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"326978a9a1d218e3f69c4e71","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-326978a9a1d218e3f69c4e71: done: 0.015207 sec","job_status":"done","queue_duration_s":1.69385,"scheduling_latency_s":1.693867,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015207,"completed_at":"2026-08-20T05:58:08.624Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 312.135779] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1dc1825c59173af41ae777e","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1dc1825c59173af41ae777e: start","job_status":"start","queue_duration_s":1.710659,"scheduling_latency_s":1.710676}1522gitlab # [ 312.148181] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1dc1825c59173af41ae777e","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1dc1825c59173af41ae777e: done: 0.020032 sec","job_status":"done","queue_duration_s":1.710659,"scheduling_latency_s":1.710676,"redis_calls":13,"redis_duration_s":0.001661,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020032,"completed_at":"2026-08-20T05:58:08.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 312.188501] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34c55eb9190b287680a127e6","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34c55eb9190b287680a127e6: start","job_status":"start","queue_duration_s":1.731865,"scheduling_latency_s":1.731882}1524gitlab # [ 312.200669] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34c55eb9190b287680a127e6","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34c55eb9190b287680a127e6: done: 0.015106 sec","job_status":"done","queue_duration_s":1.731865,"scheduling_latency_s":1.731882,"redis_calls":13,"redis_duration_s":0.0016740000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015106,"completed_at":"2026-08-20T05:58:08.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 312.239942] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fa1aeea2e69109574a24484","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fa1aeea2e69109574a24484: start","job_status":"start","queue_duration_s":1.748189,"scheduling_latency_s":1.748207}1526gitlab # [ 312.252553] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fa1aeea2e69109574a24484","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fa1aeea2e69109574a24484: done: 0.014627 sec","job_status":"done","queue_duration_s":1.748189,"scheduling_latency_s":1.748207,"redis_calls":13,"redis_duration_s":0.00156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014627,"completed_at":"2026-08-20T05:58:08.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 312.291756] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75f7f209cc1cdf3cb22d7efe","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75f7f209cc1cdf3cb22d7efe: start","job_status":"start","queue_duration_s":1.764227,"scheduling_latency_s":1.764243}1528gitlab # [ 312.304396] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75f7f209cc1cdf3cb22d7efe","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75f7f209cc1cdf3cb22d7efe: done: 0.014458 sec","job_status":"done","queue_duration_s":1.764227,"scheduling_latency_s":1.764243,"redis_calls":13,"redis_duration_s":0.001567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014458,"completed_at":"2026-08-20T05:58:08.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 312.343447] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4dd02894a747e1373ec7741","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4dd02894a747e1373ec7741: start","job_status":"start","queue_duration_s":1.779809,"scheduling_latency_s":1.779827}1530gitlab # [ 312.355988] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4dd02894a747e1373ec7741","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4dd02894a747e1373ec7741: done: 0.014687 sec","job_status":"done","queue_duration_s":1.779809,"scheduling_latency_s":1.779827,"redis_calls":13,"redis_duration_s":0.001536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014687,"completed_at":"2026-08-20T05:58:08.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 312.396555] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"232eef7c93eaddc132cf50b1","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-232eef7c93eaddc132cf50b1: start","job_status":"start","queue_duration_s":1.79561,"scheduling_latency_s":1.795627}1532gitlab # [ 312.408819] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"232eef7c93eaddc132cf50b1","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-232eef7c93eaddc132cf50b1: done: 0.015552 sec","job_status":"done","queue_duration_s":1.79561,"scheduling_latency_s":1.795627,"redis_calls":13,"redis_duration_s":0.0018999999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001349,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015552,"completed_at":"2026-08-20T05:58:08.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 312.447972] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c89baa08ae2b506c2ad90690","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c89baa08ae2b506c2ad90690: start","job_status":"start","queue_duration_s":1.812311,"scheduling_latency_s":1.812328}1534gitlab # [ 312.460592] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c89baa08ae2b506c2ad90690","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c89baa08ae2b506c2ad90690: done: 0.015402 sec","job_status":"done","queue_duration_s":1.812311,"scheduling_latency_s":1.812328,"redis_calls":13,"redis_duration_s":0.0015899999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015402,"completed_at":"2026-08-20T05:58:08.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 312.499655] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad8b0c5f1b04d6af3fa01a87","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad8b0c5f1b04d6af3fa01a87: start","job_status":"start","queue_duration_s":1.828936,"scheduling_latency_s":1.828953}1536gitlab # [ 312.512288] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad8b0c5f1b04d6af3fa01a87","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad8b0c5f1b04d6af3fa01a87: done: 0.015848 sec","job_status":"done","queue_duration_s":1.828936,"scheduling_latency_s":1.828953,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015848,"completed_at":"2026-08-20T05:58:08.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 312.551322] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2dc23aa4cd2593932cac8ab","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2dc23aa4cd2593932cac8ab: start","job_status":"start","queue_duration_s":1.846025,"scheduling_latency_s":1.846041}1538gitlab # [ 312.563690] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2dc23aa4cd2593932cac8ab","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2dc23aa4cd2593932cac8ab: done: 0.0146 sec","job_status":"done","queue_duration_s":1.846025,"scheduling_latency_s":1.846041,"redis_calls":13,"redis_duration_s":0.0015799999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0146,"completed_at":"2026-08-20T05:58:08.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 312.604480] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abd3ae749b2caa993eed0d90","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abd3ae749b2caa993eed0d90: start","job_status":"start","queue_duration_s":1.861919,"scheduling_latency_s":1.861936}1540gitlab # [ 312.616526] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abd3ae749b2caa993eed0d90","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abd3ae749b2caa993eed0d90: done: 0.014093 sec","job_status":"done","queue_duration_s":1.861919,"scheduling_latency_s":1.861936,"redis_calls":13,"redis_duration_s":0.001488,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014093,"completed_at":"2026-08-20T05:58:08.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 312.655626] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4438b83455deb7ca875a7fe3","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4438b83455deb7ca875a7fe3: start","job_status":"start","queue_duration_s":1.877134,"scheduling_latency_s":1.877151}1542gitlab # [ 312.668268] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.806Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4438b83455deb7ca875a7fe3","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4438b83455deb7ca875a7fe3: done: 0.014105 sec","job_status":"done","queue_duration_s":1.877134,"scheduling_latency_s":1.877151,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014105,"completed_at":"2026-08-20T05:58:08.806Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 312.707122] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23aea25761ad4fdc63d4fda8","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23aea25761ad4fdc63d4fda8: start","job_status":"start","queue_duration_s":1.892427,"scheduling_latency_s":1.892445}1544gitlab # [ 312.719692] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23aea25761ad4fdc63d4fda8","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23aea25761ad4fdc63d4fda8: done: 0.014437 sec","job_status":"done","queue_duration_s":1.892427,"scheduling_latency_s":1.892445,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014437,"completed_at":"2026-08-20T05:58:08.822Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 312.758980] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6925ed33bf4024578c0f91b","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6925ed33bf4024578c0f91b: start","job_status":"start","queue_duration_s":1.908026,"scheduling_latency_s":1.908044}1546gitlab # [ 312.771481] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6925ed33bf4024578c0f91b","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6925ed33bf4024578c0f91b: done: 0.014999 sec","job_status":"done","queue_duration_s":1.908026,"scheduling_latency_s":1.908044,"redis_calls":13,"redis_duration_s":0.0015370000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014999,"completed_at":"2026-08-20T05:58:08.838Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 312.812677] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99743016e8e32109b5b75367","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99743016e8e32109b5b75367: start","job_status":"start","queue_duration_s":1.924533,"scheduling_latency_s":1.924551}1548gitlab # [ 312.825047] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99743016e8e32109b5b75367","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99743016e8e32109b5b75367: done: 0.015425 sec","job_status":"done","queue_duration_s":1.924533,"scheduling_latency_s":1.924551,"redis_calls":13,"redis_duration_s":0.001536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015425,"completed_at":"2026-08-20T05:58:08.855Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 312.867059] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df45a531833c9a5171192825","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df45a531833c9a5171192825: start","job_status":"start","queue_duration_s":1.941202,"scheduling_latency_s":1.94122}1550gitlab # [ 312.905420] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df45a531833c9a5171192825","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df45a531833c9a5171192825: done: 0.014299 sec","job_status":"done","queue_duration_s":1.941202,"scheduling_latency_s":1.94122,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014299,"completed_at":"2026-08-20T05:58:08.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 312.980904] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9694bb20fc0991f7327e70a","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9694bb20fc0991f7327e70a: start","job_status":"start","queue_duration_s":1.956667,"scheduling_latency_s":1.956684}1552gitlab # [ 313.003394] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:08.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9694bb20fc0991f7327e70a","created_at":"2026-08-20T05:58:06.801Z","trace_propagation_headers":{"sentry-trace":"550df7de4d14410ea63ca4b5fa69f1bc-5490f5e58d284f99","baggage":"sentry-trace_id=550df7de4d14410ea63ca4b5fa69f1bc,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"28f043fa28a4c0867503b9e30ca2ecf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:06.915Z","job_size_bytes":2,"pid":2084,"sidekiq_tid":"m7o8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9694bb20fc0991f7327e70a: done: 0.014172 sec","job_status":"done","queue_duration_s":1.956667,"scheduling_latency_s":1.956684,"redis_calls":13,"redis_duration_s":0.0015439999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014172,"completed_at":"2026-08-20T05:58:08.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 313.698897] gitaly[911]: time="2026-08-20T05:58:11.573Z" level=info msg="burden monitor stats" pid=9111554gitlab # [ 331.649040] postgres[3400]: [3400] ERROR: relation "table_without_models" does not exist1555gitlab # [ 331.649651] postgres[3400]: [3400] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1556gitlab # [ 337.360756] runuser[3054]: pam_unix(runuser:session): session closed for user gitlab1557gitlab # [ 337.362443] setup-gitlab-start[3024]: + systemctl restart gitlab-sidekiq.service1558gitlab # [ 337.394966] systemd[1]: Stopping gitlab-sidekiq.service...1559gitlab # [ 337.526843] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:35.401Z","message":"Shutting down"}1560gitlab # [ 337.531504] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:35.401Z","message":"Scheduler exiting..."}1561gitlab # [ 337.536160] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:35.402Z","message":"Terminating quiet threads for default capsule"}1562gitlab # [ 337.541350] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:35.402Z","message":"Scheduler exiting..."}1563gitlab # [ 338.028105] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:35.903Z","message":"Pausing to allow jobs to finish..."}1564gitlab # [ 341.533540] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:39.407Z","message":"Bye!"}1565gitlab # [ 341.576144] sidekiq-cluster[2084]: {"severity":"INFO","time":"2026-08-20T05:58:39.451Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2084,"worker_id":"sidekiq_0","memwd_rss_bytes":919916544,"retry":0}1566gitlab # [ 342.692659] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1567gitlab # [ 342.693083] systemd[1]: Stopped gitlab-sidekiq.service.1568gitlab # [ 342.693303] systemd[1]: gitlab-sidekiq.service: Consumed 1min 54.532s CPU time over 3min 29.659s wall clock time, 935.3M memory peak, 4.4M read from disk.1569gitlab # [ 342.706914] systemd[1]: Started gitlab-sidekiq.service.1570gitlab # [ 342.713831] setup-gitlab-start[3024]: + mkdir -p /var/lib/secrets1571gitlab # [ 342.722165] setup-gitlab-start[3024]: + echo nixbot-test-token-of-20-chars1572gitlab # [ 342.726564] setup-gitlab-start[3024]: + chmod 644 /var/lib/secrets/gitlab-token1573gitlab # [ 342.731969] setup-gitlab-start[3024]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1574gitlab # [ 344.107808] gitaly[911]: time="2026-08-20T05:58:41.982Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:51.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:41.981" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1575gitlab # [ 344.108293] gitaly[911]: time="2026-08-20T05:58:41.983Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:51.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:41.981" grpc.time_ms=1.121 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1576gitlab # [ 344.382968] gitaly[911]: time="2026-08-20T05:58:42.258Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:52.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.258" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1577gitlab # [ 344.400252] gitaly[911]: time="2026-08-20T05:58:42.259Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:52.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.258" grpc.time_ms=0.565 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1578gitlab # [ 344.489046] gitaly[911]: time="2026-08-20T05:58:42.364Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 diskcache=dcdfc3ac-11be-48c8-bcd6-b3c49e516711 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:58:52.046" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.297" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1579gitlab # [ 344.520438] gitaly[911]: time="2026-08-20T05:58:42.365Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=38 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=41 command.spawn_token_fork_ms=2 command.system_time_ms=31 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:58:52.046" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.297" grpc.time_ms=67.887 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1580gitlab # [ 344.548307] gitaly[911]: time="2026-08-20T05:58:42.393Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:52.141" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.392" pid=911 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1581gitlab # [ 344.564294] gitaly[911]: time="2026-08-20T05:58:42.394Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:52.141" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.392" grpc.time_ms=1.589 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 344.580175] gitaly[911]: time="2026-08-20T05:58:42.423Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:58:52.152" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.403" grpc.time_ms=19.919 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 344.670834] gitaly[911]: time="2026-08-20T05:58:42.546Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:52.295" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.545" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1584gitlab # [ 344.703134] gitaly[911]: time="2026-08-20T05:58:42.546Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:52.295" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.545" grpc.time_ms=0.665 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1585gitlab # [ 344.736647] gitaly[911]: time="2026-08-20T05:58:42.604Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 diskcache=7cbe6bab-4112-40ee-bb7d-f4ec765ecc69 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:58:52.301" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.551" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1586gitlab # [ 344.761842] gitaly[911]: time="2026-08-20T05:58:42.604Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=34 command.spawn_token_fork_ms=8 command.system_time_ms=20 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:58:52.301" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.551" grpc.time_ms=53.265 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1587gitlab # [ 344.784521] gitaly[911]: time="2026-08-20T05:58:42.614Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:52.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.613" pid=911 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1588gitlab # [ 344.798778] gitaly[911]: time="2026-08-20T05:58:42.615Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:52.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.613" grpc.time_ms=1.314 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1589gitlab # [ 344.812210] gitaly[911]: time="2026-08-20T05:58:42.634Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:58:52.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.620" grpc.time_ms=13.888 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 344.834681] gitaly[911]: time="2026-08-20T05:58:42.710Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:58:52.099" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.709" grpc.time_ms=0.313 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1591gitlab # [ 344.852967] gitaly[911]: time="2026-08-20T05:58:42.725Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:58:52.113" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:42.724" grpc.time_ms=0.624 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 345.800286] gitaly[911]: time="2026-08-20T05:58:43.675Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW037YV488KGSKQZA22QV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:58:53.044" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:43.655" grpc.time_ms=19.533 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 346.272300] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:44 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 35081594gitlab # [ 346.278937] setup-gitlab-start[3024]: + mkdir -p /tmp/test-flake1595gitlab # [ 346.281873] setup-gitlab-start[3024]: + cd /tmp/test-flake1596gitlab # [ 346.284565] setup-gitlab-start[3024]: + git init -b master1597gitlab # [ 346.307029] setup-gitlab-start[3523]: Initialized empty Git repository in /tmp/test-flake/.git/1598gitlab # [ 346.310896] setup-gitlab-start[3024]: + git config user.name test1599gitlab # [ 346.313687] setup-gitlab-start[3024]: + git config user.email test@example.com1600gitlab # [ 346.316902] setup-gitlab-start[3024]: + cat1601gitlab # [ 346.318786] setup-gitlab-start[3024]: + git add flake.nix1602gitlab # [ 346.321960] setup-gitlab-start[3024]: + git commit -m 'initial commit'1603gitlab # [ 346.337330] setup-gitlab-start[3528]: [master (root-commit) 033d758] initial commit1604gitlab # [ 346.341635] setup-gitlab-start[3528]: 1 file changed, 10 insertions(+)1605gitlab # [ 346.344426] setup-gitlab-start[3528]: create mode 100644 flake.nix1606gitlab # [ 346.346999] setup-gitlab-start[3024]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1607gitlab # [ 346.354934] setup-gitlab-start[3024]: + git push -u origin master1608gitlab # [ 346.728290] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 3201609gitlab # [ 346.966854] gitaly[911]: time="2026-08-20T05:58:44.841Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW073XX4M9NRN68MMTBAMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:44.822" grpc.time_ms=18.966 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1610gitlab # [ 346.990086] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2361611gitlab # [ 348.018313] gitaly[911]: time="2026-08-20T05:58:45.892Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:58:55.266" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:45.877" grpc.time_ms=15.225 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1612gitlab # [ 348.087692] gitaly[911]: time="2026-08-20T05:58:45.963Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:59:15.047" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:58:45.947" grpc.time_ms=15.143 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1613gitlab # [ 348.130648] gitaly[911]: time="2026-08-20T05:58:46.002Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EW07C0SR223QWMC88P9K1Y duration_ms=272ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/allowed"1614gitlab # [ 348.231178] gitaly[911]: time="2026-08-20T05:58:46.106Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EW07C0SR223QWMC88P9K1Y duration_ms=102ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/pre_receive"1615gitlab # [ 348.240747] gitaly[911]: time="2026-08-20T05:58:46.107Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:45.728" grpc.time_ms=379.198 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1616gitlab # [ 348.294059] gitaly[911]: time="2026-08-20T05:58:46.169Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:46.167" grpc.time_ms=1.754 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1617gitlab # [ 348.358047] gitaly[911]: time="2026-08-20T05:58:46.233Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:46.231" grpc.time_ms=1.87 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1618gitlab # [ 348.414858] gitaly[911]: time="2026-08-20T05:58:46.290Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:46.289" grpc.time_ms=1.075 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1619gitlab # [ 348.654107] sidekiq-cluster[3467]: {"severity":"INFO","time":"2026-08-20T05:58:46.497Z","message":"Starting cluster with 1 processes"}1620gitlab # [ 348.686521] gitaly[911]: time="2026-08-20T05:58:46.562Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:58:56.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:46.553" grpc.time_ms=8.711 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 348.721618] gitaly[911]: time="2026-08-20T05:58:46.597Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:58:56.022" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:46.573" grpc.time_ms=23.043 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab # [ 348.744688] gitaly[911]: time="2026-08-20T05:58:46.620Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EW07C0SR223QWMC88P9K1Y duration_ms=277ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/post_receive"1623gitlab # [ 348.749081] gitaly[911]: time="2026-08-20T05:58:46.621Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:46.342" grpc.time_ms=279.418 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1624gitlab # [ 348.764238] gitaly[911]: time="2026-08-20T05:58:46.634Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y diskcache=5f804141-90f2-4a10-a620-1bfd2effc06d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:45.605" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1625gitlab # [ 348.778324] setup-gitlab-start[3532]: To http://gitlab/root/test-flake.git1626gitlab # [ 348.779612] setup-gitlab-start[3532]: * [new branch] master -> master1627gitlab # [ 348.780973] setup-gitlab-start[3532]: branch 'master' set up to track 'origin/master'.1628gitlab # [ 348.782865] gitlab-workhorse[817]: time="2026-08-20T05:58:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521629gitlab # [ 348.785621] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:46 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 17701630gitlab # [ 348.788644] systemd[1]: Finished setup-gitlab.service.1631gitlab # [ 348.789635] gitaly[911]: time="2026-08-20T05:58:46.635Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=377 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13584 command.oublock=32 command.real_time_ms=1020 command.spawn_token_fork_ms=2 command.system_time_ms=223 command.user_time_ms=154 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=686 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:45.605" grpc.time_ms=1029.373 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1632gitlab # [ 348.806627] systemd[1]: Starting nixbot CI service...1633gitlab: (finished: waiting for unit setup-gitlab.service, in 349.65 seconds)1634gitlab: waiting for unit nixbot.service1635gitlab # [ 350.163765] nixbot[3627]: {"ts": "2026-08-20T05:58:48.038Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1636gitlab # [ 350.189416] nixbot[3627]: {"ts": "2026-08-20T05:58:48.064Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1637gitlab # [ 350.234136] nixbot[3627]: {"ts": "2026-08-20T05:58:48.109Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1638gitlab # [ 350.243179] nixbot[3627]: {"ts": "2026-08-20T05:58:48.118Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1639gitlab # [ 350.250610] nixbot[3627]: {"ts": "2026-08-20T05:58:48.126Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1640gitlab # [ 350.262510] nixbot[3627]: {"ts": "2026-08-20T05:58:48.138Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1641gitlab # [ 350.270139] nixbot[3627]: {"ts": "2026-08-20T05:58:48.145Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1642gitlab # [ 350.274586] nixbot[3627]: {"ts": "2026-08-20T05:58:48.149Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1643gitlab # [ 350.287508] nixbot[3627]: {"ts": "2026-08-20T05:58:48.163Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1644gitlab # [ 350.295995] nixbot[3627]: {"ts": "2026-08-20T05:58:48.171Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1645gitlab # [ 350.306659] nixbot[3627]: {"ts": "2026-08-20T05:58:48.182Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1646gitlab # [ 350.319266] nixbot[3627]: {"ts": "2026-08-20T05:58:48.194Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1647gitlab # [ 350.325322] nixbot[3627]: {"ts": "2026-08-20T05:58:48.200Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1648gitlab # [ 350.332842] nixbot[3627]: {"ts": "2026-08-20T05:58:48.203Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1649gitlab # [ 350.340165] nixbot[3627]: {"ts": "2026-08-20T05:58:48.210Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1650gitlab # [ 350.347711] nixbot[3627]: {"ts": "2026-08-20T05:58:48.213Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1651gitlab # [ 350.355828] nixbot[3627]: {"ts": "2026-08-20T05:58:48.215Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1652gitlab # [ 350.362412] nixbot[3627]: {"ts": "2026-08-20T05:58:48.217Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1653gitlab # [ 350.368241] nixbot[3627]: {"ts": "2026-08-20T05:58:48.225Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1654gitlab # [ 350.374132] nixbot[3627]: {"ts": "2026-08-20T05:58:48.228Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1655gitlab # [ 350.380261] nixbot[3627]: {"ts": "2026-08-20T05:58:48.230Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1656gitlab # [ 350.385868] nixbot[3627]: {"ts": "2026-08-20T05:58:48.240Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1657gitlab # [ 350.390803] nixbot[3627]: {"ts": "2026-08-20T05:58:48.242Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1658gitlab # [ 350.395340] nixbot[3627]: {"ts": "2026-08-20T05:58:48.246Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1659gitlab # [ 350.399454] nixbot[3627]: {"ts": "2026-08-20T05:58:48.248Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1660gitlab # [ 350.785221] nixbot[3627]: INFO: Started server process [3627]1661gitlab # [ 350.792951] nixbot[3627]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1662gitlab # [ 350.807199] nixbot[3627]: INFO: ::ffff:127.0.0.1:34580 - "GET /health HTTP/1.1" 200 OK1663gitlab # [ 350.813547] systemd[1]: Started nixbot CI service.1664gitlab # [ 350.815353] systemd[1]: Reached target Multi-User System.1665gitlab # [ 350.817214] systemd[1]: Startup finished in 739ms (kernel) + 5.325s (initrd) + 5min 44.752s (userspace) = 5min 50.817s.1666gitlab: (finished: waiting for unit nixbot.service, in 2.17 seconds)1667gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1668gitlab # [ 351.453781] nixbot[3627]: INFO: ::ffff:127.0.0.1:52964 - "GET /health HTTP/1.1" 200 OK1669gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.07 seconds)1670subtest: project discovered and webhook registered1671gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1672gitlab # [ 351.650219] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1191673gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.20 seconds)1674gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1675gitlab # [ 352.774571] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 651676gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds)1677gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1678gitlab # [ 353.882198] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 681679gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.11 seconds)1680gitlab # [ 354.564753] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:52 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 37581681gitlab # [ 354.568943] nixbot[3627]: {"ts": "2026-08-20T05:58:52.443Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1682gitlab # [ 354.600225] nixbot[3627]: {"ts": "2026-08-20T05:58:52.475Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1683gitlab # [ 354.680965] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 641684gitlab # [ 354.683817] nixbot[3627]: {"ts": "2026-08-20T05:58:52.559Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1685gitlab # [ 354.687741] nixbot[3627]: {"ts": "2026-08-20T05:58:52.563Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1686gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1687gitlab # [ 355.004378] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 3111688gitlab # [ 355.007478] nixbot[3627]: {"ts": "2026-08-20T05:58:52.881Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1689gitlab # [ 355.131820] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1901690gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.25 seconds)1691(finished: subtest: project discovered and webhook registered, in 3.68 seconds)1692subtest: push delivers the webhook1693gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1694gitlab # [ 355.244395] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 471695gitlab # [ 355.290017] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2591696gitlab # [ 355.292515] nixbot[3627]: {"ts": "2026-08-20T05:58:53.165Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1697gitlab # [ 355.360358] gitaly[911]: time="2026-08-20T05:58:53.233Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FE2EB1ZFDP772B4K30W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.213" grpc.time_ms=20.405 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1698gitlab # [ 355.374754] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 204 "" "git/2.55.0" 1121699gitlab # Enumerating objects: 5, done.1700gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1701gitlab # Delta compression using up to 4 threads1702gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1703gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 68.00 KiB/s, done.1704gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1705gitlab # [ 355.568540] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 2581706gitlab # [ 355.572693] nixbot[3627]: {"ts": "2026-08-20T05:58:53.446Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1707gitlab # [ 355.672445] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 941708gitlab # [ 355.674658] nixbot[3627]: {"ts": "2026-08-20T05:58:53.549Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1709gitlab # [ 355.701094] gitaly[911]: time="2026-08-20T05:58:53.576Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:59:23.059" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:58:53.561" grpc.time_ms=14.483 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1710gitlab # [ 355.737446] gitaly[911]: time="2026-08-20T05:58:53.613Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS duration_ms=140ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/allowed"1711gitlab # [ 355.764796] gitaly[911]: time="2026-08-20T05:58:53.640Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FVQJEN819YVKPWG72R7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T05:59:23.024" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:53.624" grpc.time_ms=14.283 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1712gitlab # [ 355.802743] gitaly[911]: time="2026-08-20T05:58:53.678Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS duration_ms=55ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/pre_receive"1713gitlab # [ 355.809608] gitaly[911]: time="2026-08-20T05:58:53.678Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:53.472" grpc.time_ms=206.56 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1714gitlab # [ 355.820058] gitaly[911]: time="2026-08-20T05:58:53.682Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FVQJEN819YVKPWG72R7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:23.078" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:58:53.679" grpc.time_ms=3.231 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1715gitlab # [ 355.838219] gitaly[911]: time="2026-08-20T05:58:53.713Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FVQJEN819YVKPWG72R7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T05:59:03.146" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:58:53.696" grpc.time_ms=16.916 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1716gitlab # [ 355.856210] gitaly[911]: time="2026-08-20T05:58:53.731Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:53.731" grpc.time_ms=0.62 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1717gitlab # [ 355.898032] gitaly[911]: time="2026-08-20T05:58:53.773Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:53.772" grpc.time_ms=0.505 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1718gitlab # [ 355.910765] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2141719gitlab # [ 355.913227] nixbot[3627]: {"ts": "2026-08-20T05:58:53.778Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1720gitlab # [ 355.945983] gitaly[911]: time="2026-08-20T05:58:53.821Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:53.820" grpc.time_ms=0.895 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1721gitlab # [ 356.067629] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1571722gitlab # [ 356.071257] nixbot[3627]: {"ts": "2026-08-20T05:58:53.944Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1723gitlab # [ 356.079652] nixbot[3627]: {"ts": "2026-08-20T05:58:53.955Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1724gitlab # [ 356.186666] gitaly[911]: time="2026-08-20T05:58:54.061Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS duration_ms=187ns method=POST pid=911 status=200 url="http://unix/api/v4/internal/post_receive"1725gitlab # [ 356.197122] gitaly[911]: time="2026-08-20T05:58:54.062Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:53.872" grpc.time_ms=189.537 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1726gitlab # [ 356.224653] gitaly[911]: time="2026-08-20T05:58:54.100Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS diskcache=c1eccad1-0ef5-41da-a69a-6dae4594a37d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.371" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1727gitlab # [ 356.245551] gitaly[911]: time="2026-08-20T05:58:54.100Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=235 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13370 command.oublock=32 command.real_time_ms=704 command.spawn_token_fork_ms=2 command.system_time_ms=131 command.user_time_ms=104 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:53.371" grpc.time_ms=728.961 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1728gitlab # To http://gitlab/root/test-flake.git1729gitlab # [ 356.267530] gitlab-workhorse[817]: time="2026-08-20T05:58:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521730gitlab # 033d758..469e5ce [ 356.270717] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:54 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 8161731gitlab # master -> master[ 356.273450] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1041732gitlab # 1733gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.16 seconds)1734gitlab # [ 356.275654] gitaly[911]: time="2026-08-20T05:58:54.102Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0G9F4DXNEG1SJSWHFVX7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.090" grpc.time_ms=12.326 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1735gitlab: must succeed: git -C /tmp/test-flake rev-parse master1736gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1737gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1738gitlab # [ 356.406479] nixbot[3627]: INFO: ::ffff:127.0.0.1:52972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1739gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.11 seconds)1740gitlab # [ 356.445556] gitaly[911]: time="2026-08-20T05:58:54.320Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0GCWXMSF530BEAT77MYN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.307" pid=911 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1741gitlab # [ 356.461388] gitaly[911]: time="2026-08-20T05:58:54.328Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0GCWXMSF530BEAT77MYN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.307" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1742gitlab # [ 356.479140] gitlab-workhorse[817]: time="2026-08-20T05:58:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131743gitlab # [ 356.481779] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 2211744gitlab # [ 356.484110] gitaly[911]: time="2026-08-20T05:58:54.328Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0GCWXMSF530BEAT77MYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.307" grpc.time_ms=20.853 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1745gitlab # [ 356.624475] gitaly[911]: time="2026-08-20T05:58:54.500Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0GM55QTG9QXQBVCQZBQ0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.461" pid=911 remote_ip="2001:db8:1::1" request_sha=37c134ceb2bdd77edaaa42783d57b4cf0825435c response_bytes=418 span.kind=server system=grpc1746gitlab # [ 356.654739] gitaly[911]: time="2026-08-20T05:58:54.500Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=31 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0GM55QTG9QXQBVCQZBQ0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.461" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1747gitlab # [ 356.687349] gitlab-workhorse[817]: time="2026-08-20T05:58:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4181748gitlab # [ 356.692184] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 1591749gitlab # [ 356.695641] gitaly[911]: time="2026-08-20T05:58:54.500Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=31 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0GM55QTG9QXQBVCQZBQ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.461" grpc.time_ms=39.04 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1750gitlab # [ 356.808074] gitaly[911]: time="2026-08-20T05:58:54.683Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0GVECAYQ0R23S9W4PCWY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.667" grpc.time_ms=16.131 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1751gitlab # [ 356.845934] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1091752gitlab # [ 356.915303] gitaly[911]: time="2026-08-20T05:58:54.790Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0GYY1KA69DHFVCSETSCP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.773" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1753gitlab # [ 356.946282] gitaly[911]: time="2026-08-20T05:58:54.791Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0GYY1KA69DHFVCSETSCP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.773" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1754gitlab # [ 356.974402] gitlab-workhorse[817]: time="2026-08-20T05:58:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671755gitlab # [ 356.977583] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1061756gitlab # [ 356.980673] gitaly[911]: time="2026-08-20T05:58:54.792Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0GYY1KA69DHFVCSETSCP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.773" grpc.time_ms=17.941 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1757gitlab # [ 357.113988] gitaly[911]: time="2026-08-20T05:58:54.989Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0H4BXVNKNPV5WC717YVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:54.969" grpc.time_ms=20.061 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1758gitlab # [ 357.153413] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1321759gitlab # [ 357.274501] gitaly[911]: time="2026-08-20T05:58:55.149Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0H8KPQ25P1WB0RCW27V4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:55.116" pid=911 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1760gitlab # [ 357.307814] gitaly[911]: time="2026-08-20T05:58:55.150Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0H8KPQ25P1WB0RCW27V4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:55.116" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1761gitlab # [ 357.343312] gitlab-workhorse[817]: time="2026-08-20T05:58:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091762gitlab # [ 357.347162] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1571763gitlab # [ 357.350857] gitaly[911]: time="2026-08-20T05:58:55.151Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0H8KPQ25P1WB0RCW27V4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:58:55.116" grpc.time_ms=34.384 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1764gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1765gitlab # [ 357.466350] gitaly[911]: time="2026-08-20T05:58:55.340Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:25.038" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:58:55.338" grpc.time_ms=1.003 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.10 seconds)1767gitlab # [ 357.505177] nixbot[3627]: INFO: ::ffff:127.0.0.1:52984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1768gitlab # [ 357.511775] gitaly[911]: time="2026-08-20T05:58:55.382Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=589 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:59:25.071" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:55.372" grpc.time_ms=10.526 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 357.540781] gitaly[911]: time="2026-08-20T05:58:55.410Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:05.149" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:55.400" grpc.time_ms=10.239 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 357.560925] gitaly[911]: time="2026-08-20T05:58:55.432Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:05.170" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:55.421" grpc.time_ms=10.601 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 357.656389] gitaly[911]: time="2026-08-20T05:58:55.532Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:59:05.280" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:55.531" grpc.time_ms=0.686 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 357.687542] gitaly[911]: time="2026-08-20T05:58:55.563Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:59:05.300" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:58:55.551" grpc.time_ms=11.051 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 357.779253] gitaly[911]: time="2026-08-20T05:58:55.654Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:55.653" grpc.time_ms=0.85 pid=911 span.kind=server system=grpc1774gitlab # [ 357.840661] gitaly[911]: time="2026-08-20T05:58:55.716Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:58:55.708" grpc.time_ms=1.654 pid=911 span.kind=server system=grpc1775gitlab # [ 357.869230] gitaly[911]: time="2026-08-20T05:58:55.723Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV diskcache=d2c96e18-dde8-491b-adfd-4d41202a79e9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:59:05.005" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:55.586" pid=911 ref=refs/keep-around/033d7582398e9bef590efff8854214897015f02b remote_ip="2001:db8:1::1" revision=033d7582398e9bef590efff8854214897015f02b span.kind=server system=grpc username=root1776gitlab # [ 357.891462] gitaly[911]: time="2026-08-20T05:58:55.724Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=126 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5153 command.oublock=8 command.real_time_ms=127 command.spawn_token_fork_ms=2 command.system_time_ms=78 command.user_time_ms=48 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:59:05.005" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:55.586" grpc.time_ms=137.519 pid=911 ref=refs/keep-around/033d7582398e9bef590efff8854214897015f02b remote_ip="2001:db8:1::1" revision=033d7582398e9bef590efff8854214897015f02b span.kind=server system=grpc username=root1777gitlab # [ 357.914313] gitaly[911]: time="2026-08-20T05:58:55.753Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:25.451" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:58:55.752" grpc.time_ms=0.892 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1778gitlab # [ 358.162709] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:58:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 8051779gitlab # [ 358.166591] nixbot[3627]: {"ts": "2026-08-20T05:58:56.040Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}1780gitlab # [ 358.182496] nixbot[3627]: {"ts": "2026-08-20T05:58:56.057Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-033d7582398e-0"}1781gitlab # [ 358.303823] systemd[1]: Started Nix Daemon.1782gitlab # [ 358.414666] nix-daemon[3857]: accepted connection from pid 3851, user nixbot1783gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1784gitlab # [ 358.537091] nix-daemon[3857]: accepted connection from pid 3864, user nixbot1785gitlab # [ 358.566940] nixbot[3627]: {"ts": "2026-08-20T05:58:56.441Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-033d7582398e-0", "argv0": "bwrap"}1786gitlab # [ 358.609516] nixbot[3627]: INFO: ::ffff:127.0.0.1:53000 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1787gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.11 seconds)1788gitlab # [ 358.788326] nix-daemon[3857]: accepted connection from pid 3877, user nixbot1789gitlab # [ 358.874036] nix-daemon[3857]: accepted connection from pid 3887, user nixbot1790gitlab # [ 358.893797] nix-daemon[3857]: accepted connection from pid 3877, user nixbot1791gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1792gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1793gitlab # [ 359.672069] nixbot[3627]: INFO: ::ffff:127.0.0.1:53014 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1794gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1795gitlab # [ 360.730695] nixbot[3627]: INFO: ::ffff:127.0.0.1:53030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1796gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1797gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1798gitlab # [ 361.789859] nixbot[3627]: INFO: ::ffff:127.0.0.1:32928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1799gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1800gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1801gitlab # [ 362.846613] nixbot[3627]: INFO: ::ffff:127.0.0.1:32942 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1802gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1803gitlab # [ 363.227323] gitaly[911]: time="2026-08-20T05:59:01.102Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0Q40PTKF6DHYJMRYSWBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:31.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:01.100" grpc.time_ms=1.177 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 363.326821] gitaly[911]: time="2026-08-20T05:59:01.202Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0Q40PTKF6DHYJMRYSWBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:11.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:01.183" grpc.time_ms=18.223 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 363.455296] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3371806gitlab # [ 363.460248] nixbot[3627]: {"ts": "2026-08-20T05:59:01.332Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}1807gitlab # [ 363.588679] gitaly[911]: time="2026-08-20T05:59:01.464Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0QEXZX6RK5RN0VFWE4HY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:31.061" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:01.462" grpc.time_ms=1.515 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1809gitlab # [ 363.844394] gitaly[911]: time="2026-08-20T05:59:01.719Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0QEXZX6RK5RN0VFWE4HY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:11.149" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:01.700" grpc.time_ms=19.059 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.08 seconds)1811gitlab # [ 363.923227] nixbot[3627]: INFO: ::ffff:127.0.0.1:32944 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1812gitlab # [ 364.014849] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 5481813gitlab # [ 364.023245] nixbot[3627]: {"ts": "2026-08-20T05:59:01.891Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}1814gitlab # [ 364.107499] gitaly[911]: time="2026-08-20T05:59:01.982Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0R0R1K0JKADHWXXK7QSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:31.380" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:01.981" grpc.time_ms=1.254 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 364.177964] gitaly[911]: time="2026-08-20T05:59:02.053Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0R0R1K0JKADHWXXK7QSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:12.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:02.034" grpc.time_ms=19.308 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 364.240392] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2031817gitlab # [ 364.243468] nixbot[3627]: {"ts": "2026-08-20T05:59:02.118Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}1818gitlab # [ 364.413101] nix-daemon[3857]: accepted connection from pid 3927, user nixbot1819gitlab # [ 364.626387] gitaly[911]: time="2026-08-20T05:59:02.500Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0RFH26GA1W1AN3K95BD5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:02.482" grpc.time_ms=17.819 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1820gitlab # [ 364.669030] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1181821gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1822gitlab # [ 364.915436] gitaly[911]: time="2026-08-20T05:59:02.791Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0RKB2BHH28PJZG9PCMBK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:02.770" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1823gitlab # [ 364.948360] gitaly[911]: time="2026-08-20T05:59:02.791Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0RKB2BHH28PJZG9PCMBK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:02.770" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1824gitlab # [ 364.980435] gitlab-workhorse[817]: time="2026-08-20T05:59:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1826gitlab # [ 364.983918] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 2841827gitlab # [ 364.988392] nixbot[3627]: INFO: ::ffff:127.0.0.1:32958 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1828gitlab # [ 364.991924] gitaly[911]: time="2026-08-20T05:59:02.791Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0RKB2BHH28PJZG9PCMBK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:02.770" grpc.time_ms=21.103 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc1829gitlab # [ 365.052455] nix-daemon[3857]: accepted connection from pid 3959, user nixbot1830gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1831gitlab # [ 366.036590] nixbot[3627]: INFO: ::ffff:127.0.0.1:32960 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1832gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1833gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1834gitlab # [ 367.094242] nixbot[3627]: INFO: ::ffff:127.0.0.1:32970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1835gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1836gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1837gitlab # [ 368.151117] nixbot[3627]: INFO: ::ffff:127.0.0.1:32982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1838gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1839gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1840gitlab # [ 369.212389] nixbot[3627]: INFO: ::ffff:127.0.0.1:32988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1841gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1842gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1843gitlab # [ 370.275023] nixbot[3627]: INFO: ::ffff:127.0.0.1:32990 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1844gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1845gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1846gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1847gitlab # [ 371.331897] nixbot[3627]: INFO: ::ffff:127.0.0.1:50262 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1848gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1849gitlab # [ 372.388209] nixbot[3627]: INFO: ::ffff:127.0.0.1:50272 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1850gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1851gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1852gitlab # [ 373.446342] nixbot[3627]: INFO: ::ffff:127.0.0.1:50286 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1853gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1854gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1855gitlab # [ 374.504952] nixbot[3627]: INFO: ::ffff:127.0.0.1:50288 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1856gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1857gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1858gitlab # [ 375.562472] nixbot[3627]: INFO: ::ffff:127.0.0.1:50292 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1859gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1860gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1861gitlab # [ 376.626612] nixbot[3627]: INFO: ::ffff:127.0.0.1:50306 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1862gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1863gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1864gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1865gitlab # [ 377.686384] nixbot[3627]: INFO: ::ffff:127.0.0.1:50312 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1866gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1867gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1868gitlab # [ 378.743165] nixbot[3627]: INFO: ::ffff:127.0.0.1:50322 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1869gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1870gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1871gitlab # [ 379.798871] nixbot[3627]: INFO: ::ffff:127.0.0.1:50326 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1872gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1873gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1874gitlab # [ 380.857978] nixbot[3627]: INFO: ::ffff:127.0.0.1:39440 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1875gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1876gitlab # [ 381.915096] nixbot[3627]: INFO: ::ffff:127.0.0.1:39442 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1877gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1878gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1879gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1880gitlab # [ 382.973772] nixbot[3627]: INFO: ::ffff:127.0.0.1:39448 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1881gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1882gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1883gitlab # [ 384.026533] nixbot[3627]: INFO: ::ffff:127.0.0.1:39452 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1884gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1885gitlab # [ 385.084697] nixbot[3627]: INFO: ::ffff:127.0.0.1:39454 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1886gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1887gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1888gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1889gitlab # [ 386.140449] nixbot[3627]: INFO: ::ffff:127.0.0.1:39470 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1891gitlab # [ 387.197296] nixbot[3627]: INFO: ::ffff:127.0.0.1:39474 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1892gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1893gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1894gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1895gitlab # [ 388.252566] nixbot[3627]: INFO: ::ffff:127.0.0.1:39486 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1896gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1897gitlab # [ 389.308484] nixbot[3627]: INFO: ::ffff:127.0.0.1:39488 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1898gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1899gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1900gitlab # [ 390.364193] nixbot[3627]: INFO: ::ffff:127.0.0.1:39496 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1901gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1902gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1903gitlab # [ 391.422732] nixbot[3627]: INFO: ::ffff:127.0.0.1:39586 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1904gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1905gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1906gitlab # [ 392.478706] nixbot[3627]: INFO: ::ffff:127.0.0.1:39594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1907gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1908gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1909gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1910gitlab # [ 393.536539] nixbot[3627]: INFO: ::ffff:127.0.0.1:39610 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1911gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1912gitlab # [ 394.590227] nixbot[3627]: INFO: ::ffff:127.0.0.1:39620 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1913gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1914gitlab # [ 394.656160] sidekiq-cluster[3608]: 2026-08-20T05:59:32.530Z pid=3608 tid=y40 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3608, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>427143168}1915gitlab # [ 394.971323] sidekiq-cluster[3608]: W, [2026-08-20T05:59:32.846770 #3608] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1916gitlab # [ 395.138100] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T05:59:33.013Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1917gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1918gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1919gitlab # [ 395.652163] nixbot[3627]: INFO: ::ffff:127.0.0.1:39622 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1920gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1921gitlab # [ 396.708329] nixbot[3627]: INFO: ::ffff:127.0.0.1:39628 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1922gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1923gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1924gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1925gitlab # [ 397.766884] nixbot[3627]: INFO: ::ffff:127.0.0.1:39636 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1926gitlab # [ 398.322109] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T05:59:36.196Z","message":"GitLab reliable fetch activated!"}1927gitlab # [ 398.328390] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T05:59:36.196Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1928gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1929gitlab # [ 398.822514] nixbot[3627]: INFO: ::ffff:127.0.0.1:39652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1930gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1931gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1932gitlab # [ 399.880144] nixbot[3627]: INFO: ::ffff:127.0.0.1:39658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1933gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1934gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1935gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1936gitlab # [ 400.939080] nixbot[3627]: INFO: ::ffff:127.0.0.1:41336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1937gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1938gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1939gitlab # [ 401.996268] nixbot[3627]: INFO: ::ffff:127.0.0.1:41344 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1940gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1941gitlab # [ 403.052367] nixbot[3627]: INFO: ::ffff:127.0.0.1:41358 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1942gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1943gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1944gitlab # [ 404.108167] nixbot[3627]: INFO: ::ffff:127.0.0.1:41364 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1945gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1946gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1947gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1948gitlab # [ 405.165270] nixbot[3627]: INFO: ::ffff:127.0.0.1:41366 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1949gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1950gitlab # [ 406.219793] nixbot[3627]: INFO: ::ffff:127.0.0.1:41376 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1951gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1952gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1953gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1954gitlab # [ 407.276753] nixbot[3627]: INFO: ::ffff:127.0.0.1:41384 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1955gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1957gitlab # [ 408.332862] nixbot[3627]: INFO: ::ffff:127.0.0.1:41400 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1958gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1959gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1960gitlab # [ 409.388250] nixbot[3627]: INFO: ::ffff:127.0.0.1:41408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1961gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1962gitlab # [ 410.442786] nixbot[3627]: INFO: ::ffff:127.0.0.1:41422 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1963gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1964gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1965gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1966gitlab # [ 411.498596] nixbot[3627]: INFO: ::ffff:127.0.0.1:59974 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1967gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1969gitlab # [ 412.553631] nixbot[3627]: INFO: ::ffff:127.0.0.1:59990 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1970gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1972gitlab # [ 413.607500] nixbot[3627]: INFO: ::ffff:127.0.0.1:59996 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1973gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1974gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1975gitlab # [ 414.663131] nixbot[3627]: INFO: ::ffff:127.0.0.1:60012 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1976gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1978gitlab # [ 415.719824] nixbot[3627]: INFO: ::ffff:127.0.0.1:60022 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1979gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1980gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1981gitlab # [ 416.777050] nixbot[3627]: INFO: ::ffff:127.0.0.1:60030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1982gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1983gitlab # [ 417.832096] nixbot[3627]: INFO: ::ffff:127.0.0.1:60032 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1984gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1985gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1986gitlab # [ 418.889553] nixbot[3627]: INFO: ::ffff:127.0.0.1:60040 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1987gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1988gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1989gitlab # [ 419.945505] nixbot[3627]: INFO: ::ffff:127.0.0.1:60054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1990gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1992gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)1993gitlab # [ 421.002122] nixbot[3627]: INFO: ::ffff:127.0.0.1:50694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1995gitlab # [ 422.055520] nixbot[3627]: INFO: ::ffff:127.0.0.1:50700 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)1997gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'1998gitlab # [ 423.092355] systemd[1]: Starting Logrotate Service...1999gitlab # [ 423.112742] nixbot[3627]: INFO: ::ffff:127.0.0.1:50716 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2001gitlab # [ 423.166834] systemd[1]: logrotate.service: Deactivated successfully.2002gitlab # [ 423.168186] systemd[1]: Finished Logrotate Service.2003gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2004gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2005gitlab # [ 424.177607] nixbot[3627]: INFO: ::ffff:127.0.0.1:50732 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2006gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2007gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2008gitlab # [ 425.237778] nixbot[3627]: INFO: ::ffff:127.0.0.1:50736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2009gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2011gitlab # [ 426.298903] nixbot[3627]: INFO: ::ffff:127.0.0.1:50744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2012gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2013gitlab # [ 427.359557] nixbot[3627]: INFO: ::ffff:127.0.0.1:50752 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2015gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2016gitlab # [ 428.420652] nixbot[3627]: INFO: ::ffff:127.0.0.1:50756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2017gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2018gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2019gitlab # [ 429.481070] nixbot[3627]: INFO: ::ffff:127.0.0.1:50762 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2020gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2021gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2022gitlab # [ 430.538825] nixbot[3627]: INFO: ::ffff:127.0.0.1:50766 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2023gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2025gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2026gitlab # [ 431.596813] nixbot[3627]: INFO: ::ffff:127.0.0.1:52290 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2027gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2028gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)2029gitlab # [ 432.651029] nixbot[3627]: INFO: ::ffff:127.0.0.1:52300 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2030gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2031gitlab # [ 433.709270] nixbot[3627]: INFO: ::ffff:127.0.0.1:52308 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2032gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2033gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2034gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)2035gitlab # [ 434.765013] nixbot[3627]: INFO: ::ffff:127.0.0.1:52320 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2038gitlab # [ 435.826241] nixbot[3627]: INFO: ::ffff:127.0.0.1:52326 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2039gitlab # [ 436.035309] postgres[4184]: [4184] ERROR: relation "table_without_models" does not exist2040gitlab # [ 436.039016] postgres[4184]: [4184] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2041gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2042gitlab # [ 436.882852] nixbot[3627]: INFO: ::ffff:127.0.0.1:52336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2044gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2045gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2046gitlab # [ 437.941478] nixbot[3627]: INFO: ::ffff:127.0.0.1:52348 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2047gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2048gitlab # [ 438.996340] nixbot[3627]: INFO: ::ffff:127.0.0.1:52362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2049gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2050gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2051gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2052gitlab # [ 440.057378] nixbot[3627]: INFO: ::ffff:127.0.0.1:52374 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2053gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2054gitlab # [ 441.108107] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:18.976Z","message":"Booted Rails 7.2.3.1 application in production environment"}2055gitlab # [ 441.108357] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:18.982Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2056gitlab # [ 441.108501] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:18.983Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2057gitlab # [ 441.108587] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:18.983Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2058gitlab # [ 441.116084] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:18.990Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2059gitlab # [ 441.119716] nixbot[3627]: INFO: ::ffff:127.0.0.1:45248 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2060gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2061gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2062gitlab # [ 442.177642] nixbot[3627]: INFO: ::ffff:127.0.0.1:45254 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2063gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2064gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2065gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2066gitlab # [ 443.236156] nixbot[3627]: INFO: ::ffff:127.0.0.1:45260 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2067gitlab # [ 443.850945] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:21.724Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"cda1deebaa2ddb7f107c96b5","created_at":"2026-08-20T05:58:42.449Z","trace_propagation_headers":{"sentry-trace":"74084f6392e547089ba24660ed4bafae-f6b439509763417d","baggage":"sentry-trace_id=74084f6392e547089ba24660ed4bafae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW037YV488KGSKQZA22QV2","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:42.510Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-cda1deebaa2ddb7f107c96b5: start","job_status":"start","queue_duration_s":99.214298,"scheduling_latency_s":99.214398}2068gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2069gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.05 seconds)2070gitlab # [ 444.248709] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:22.123Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"cda1deebaa2ddb7f107c96b5","created_at":"2026-08-20T05:58:42.449Z","trace_propagation_headers":{"sentry-trace":"74084f6392e547089ba24660ed4bafae-f6b439509763417d","baggage":"sentry-trace_id=74084f6392e547089ba24660ed4bafae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW037YV488KGSKQZA22QV2","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:42.510Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-cda1deebaa2ddb7f107c96b5: done: 0.398595 sec","job_status":"done","queue_duration_s":99.214298,"scheduling_latency_s":99.214398,"redis_calls":23,"redis_duration_s":0.011295,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.006458,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002732,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002105,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.196267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20102464,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.398595,"completed_at":"2026-08-20T06:00:22.122Z","load_balancing_strategy":"primary","db_duration_s":0.111504,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2071gitlab # [ 444.359346] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:22.126Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"62e95b6c9d9e3581661f771c","created_at":"2026-08-20T05:58:42.529Z","trace_propagation_headers":{"sentry-trace":"74084f6392e547089ba24660ed4bafae-f6b439509763417d","baggage":"sentry-trace_id=74084f6392e547089ba24660ed4bafae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW037YV488KGSKQZA22QV2","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:42.537Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-62e95b6c9d9e3581661f771c: start","job_status":"start","queue_duration_s":99.588637,"scheduling_latency_s":99.588679}2072gitlab # [ 444.379916] nixbot[3627]: INFO: ::ffff:127.0.0.1:45276 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2073gitlab # [ 444.457286] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:22.332Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"62e95b6c9d9e3581661f771c","created_at":"2026-08-20T05:58:42.529Z","trace_propagation_headers":{"sentry-trace":"74084f6392e547089ba24660ed4bafae-f6b439509763417d","baggage":"sentry-trace_id=74084f6392e547089ba24660ed4bafae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW037YV488KGSKQZA22QV2","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:42.537Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-62e95b6c9d9e3581661f771c: done: 0.20556 sec","job_status":"done","queue_duration_s":99.588637,"scheduling_latency_s":99.588679,"redis_calls":14,"redis_duration_s":0.006269,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001549,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002821,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.158428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15530164000000002,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.20556,"completed_at":"2026-08-20T06:00:22.332Z","load_balancing_strategy":"primary","db_duration_s":0.033474,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2074gitlab # [ 444.551713] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:22.335Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"258a9afe2cabc517730fb461","created_at":"2026-08-20T05:58:43.483Z","trace_propagation_headers":{"sentry-trace":"74084f6392e547089ba24660ed4bafae-f6b439509763417d","baggage":"sentry-trace_id=74084f6392e547089ba24660ed4bafae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW037YV488KGSKQZA22QV2","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:43.492Z","job_size_bytes":5,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-258a9afe2cabc517730fb461: start","job_status":"start","queue_duration_s":98.842475,"scheduling_latency_s":98.842512}2075gitlab # [ 444.719555] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:22.594Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"258a9afe2cabc517730fb461","created_at":"2026-08-20T05:58:43.483Z","trace_propagation_headers":{"sentry-trace":"74084f6392e547089ba24660ed4bafae-f6b439509763417d","baggage":"sentry-trace_id=74084f6392e547089ba24660ed4bafae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW037YV488KGSKQZA22QV2","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:43.492Z","job_size_bytes":5,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-258a9afe2cabc517730fb461: done: 0.259247 sec","job_status":"done","queue_duration_s":98.842475,"scheduling_latency_s":98.842512,"redis_calls":12,"redis_duration_s":0.0040219999999999995,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000985,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002394,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000643,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041724,"duration_s":0.259247,"completed_at":"2026-08-20T06:00:22.594Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046541,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2076gitlab # [ 444.820134] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:22.596Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"21554eb5b92e3c0cb66ca26d","created_at":"2026-08-20T05:58:43.530Z","trace_propagation_headers":{"sentry-trace":"74084f6392e547089ba24660ed4bafae-f6b439509763417d","baggage":"sentry-trace_id=74084f6392e547089ba24660ed4bafae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW037YV488KGSKQZA22QV2","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:43.537Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-21554eb5b92e3c0cb66ca26d: start","job_status":"start","queue_duration_s":99.059179,"scheduling_latency_s":99.059206}2077gitlab # [ 445.025802] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:22.899Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"21554eb5b92e3c0cb66ca26d","created_at":"2026-08-20T05:58:43.530Z","trace_propagation_headers":{"sentry-trace":"74084f6392e547089ba24660ed4bafae-f6b439509763417d","baggage":"sentry-trace_id=74084f6392e547089ba24660ed4bafae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW037YV488KGSKQZA22QV2","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:43.537Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-21554eb5b92e3c0cb66ca26d: done: 0.302945 sec","job_status":"done","queue_duration_s":99.059179,"scheduling_latency_s":99.059206,"redis_calls":11,"redis_duration_s":0.00351,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000846,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001998,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000666,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.25,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.25,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.186324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058518,"duration_s":0.302945,"completed_at":"2026-08-20T06:00:22.899Z","load_balancing_strategy":"primary","db_duration_s":0.114778,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2078gitlab # [ 445.130209] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:22.902Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0c908348e3d768f4365b3033","created_at":"2026-08-20T05:58:43.541Z","trace_propagation_headers":{"sentry-trace":"74084f6392e547089ba24660ed4bafae-f6b439509763417d","baggage":"sentry-trace_id=74084f6392e547089ba24660ed4bafae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW037YV488KGSKQZA22QV2","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:43.548Z","job_size_bytes":89,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0c908348e3d768f4365b3033: start","job_status":"start","queue_duration_s":99.353941,"scheduling_latency_s":99.35397}2079gitlab # [ 445.152095] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:22.956Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0c908348e3d768f4365b3033","created_at":"2026-08-20T05:58:43.541Z","trace_propagation_headers":{"sentry-trace":"74084f6392e547089ba24660ed4bafae-f6b439509763417d","baggage":"sentry-trace_id=74084f6392e547089ba24660ed4bafae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW037YV488KGSKQZA22QV2","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:43.548Z","job_size_bytes":89,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0c908348e3d768f4365b3033: done: 0.053688 sec","job_status":"done","queue_duration_s":99.353941,"scheduling_latency_s":99.35397,"redis_calls":11,"redis_duration_s":0.00351,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00094,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001933,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000637,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005833,"duration_s":0.053688,"completed_at":"2026-08-20T06:00:22.956Z","load_balancing_strategy":"primary","db_duration_s":0.009016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2080gitlab # [ 445.199080] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:22.958Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 033d7582398e9bef590efff8854214897015f02b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c0fb5e0e36fefd1d147794f3","created_at":"2026-08-20T05:58:46.446Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-589a1df497ba4f0e","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:46.491Z","job_size_bytes":185,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c0fb5e0e36fefd1d147794f3: start","job_status":"start","queue_duration_s":96.46689,"scheduling_latency_s":96.466918}2081gitlab # [ 445.217121] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:22.983Z","message":"changes: \"0000000000000000000000000000000000000000 033d7582398e9bef590efff8854214897015f02b refs/heads/master\\n\""}2082gitlab # [ 445.219971] gitaly[911]: time="2026-08-20T06:00:23.042Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:33.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:23.023" grpc.time_ms=19.247 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 445.233860] gitaly[911]: time="2026-08-20T06:00:23.068Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:00:33.030" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:23.050" grpc.time_ms=17.097 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2085gitlab # [ 445.301276] gitaly[911]: time="2026-08-20T06:00:23.176Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T06:00:33.134" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:23.155" grpc.time_ms=21.384 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 445.346206] nixbot[3627]: INFO: ::ffff:127.0.0.1:45278 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2087gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2088gitlab # [ 445.391318] gitaly[911]: time="2026-08-20T06:00:23.266Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:23.265" grpc.time_ms=0.867 pid=911 span.kind=server system=grpc2089gitlab # [ 445.446910] gitaly[911]: time="2026-08-20T06:00:23.322Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:23.321" grpc.time_ms=0.737 pid=911 span.kind=server system=grpc2090gitlab # [ 445.470267] gitaly[911]: time="2026-08-20T06:00:23.340Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y diskcache=b309a633-2ce5-4821-8baa-cb0281627a63 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:33.186" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:23.207" pid=911 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2091gitlab # [ 445.490121] gitaly[911]: time="2026-08-20T06:00:23.340Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=136 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5156 command.oublock=8 command.real_time_ms=125 command.spawn_token_fork_ms=1 command.system_time_ms=61 command.user_time_ms=75 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:33.186" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:23.207" grpc.time_ms=133.22 pid=911 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2092gitlab # [ 445.510593] gitaly[911]: time="2026-08-20T06:00:23.374Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:00:33.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:23.374" grpc.time_ms=0.34 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 445.532265] gitaly[911]: time="2026-08-20T06:00:23.407Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=859 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T06:00:33.011" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:23.381" grpc.time_ms=25.725 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2094gitlab # [ 445.716202] gitaly[911]: time="2026-08-20T06:00:23.591Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T06:00:53.077" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:23.578" grpc.time_ms=13.081 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2095gitlab # [ 445.774911] gitaly[911]: time="2026-08-20T06:00:23.650Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:00:33.278" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:23.649" grpc.time_ms=0.592 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 445.799101] gitaly[911]: time="2026-08-20T06:00:23.667Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T06:00:33.284" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T06:00:23.655" grpc.time_ms=12.207 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097gitlab # [ 445.840491] gitaly[911]: time="2026-08-20T06:00:23.716Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:33.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:23.697" grpc.time_ms=18.007 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 445.880565] gitaly[911]: time="2026-08-20T06:00:23.744Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:33.037" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:23.727" grpc.time_ms=16.488 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 445.924166] gitaly[911]: time="2026-08-20T06:00:23.799Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=883 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:00:53.270" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:23.771" grpc.time_ms=28.106 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2101gitlab # [ 446.410645] nixbot[3627]: INFO: ::ffff:127.0.0.1:45294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2102gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2103gitlab # [ 446.620703] gitaly[911]: time="2026-08-20T06:00:24.495Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T06:00:34.122" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:24.492" grpc.time_ms=2.483 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab # [ 446.667412] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:24.541Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 033d7582398e9bef590efff8854214897015f02b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c0fb5e0e36fefd1d147794f3","created_at":"2026-08-20T05:58:46.446Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-589a1df497ba4f0e","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:46.491Z","job_size_bytes":185,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c0fb5e0e36fefd1d147794f3: done: 1.582854 sec","job_status":"done","queue_duration_s":96.46689,"scheduling_latency_s":96.466918,"gitaly_calls":13,"gitaly_duration_s":0.372611,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.076178,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.007673,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.010014,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002685,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.007083,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.03329,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015433,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.095,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.314,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.363,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.095,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.052166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00099672,"exclusive_lock_hold_duration_s":0.04598164,"duration_s":1.582854,"completed_at":"2026-08-20T06:00:24.541Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.166382,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2105gitlab # [ 446.770117] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:24.543Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","033d7582398e9bef590efff8854214897015f02b 469e5ce4513aa1d1884c5c76cf26249d4cd34009 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"50ba5d1fb98339c6da142b8b","created_at":"2026-08-20T05:58:54.011Z","trace_propagation_headers":{"sentry-trace":"34bc15083a02428d9f548c7d1b074284-6c21b7483fa74ccb","baggage":"sentry-trace_id=34bc15083a02428d9f548c7d1b074284,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:54.021Z","job_size_bytes":185,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-50ba5d1fb98339c6da142b8b: start","job_status":"start","queue_duration_s":90.522821,"scheduling_latency_s":90.522846}2106gitlab # [ 446.788620] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:24.559Z","message":"changes: \"033d7582398e9bef590efff8854214897015f02b 469e5ce4513aa1d1884c5c76cf26249d4cd34009 refs/heads/master\\n\""}2107gitlab # [ 446.791077] gitaly[911]: time="2026-08-20T06:00:24.614Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:34.230" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:24.600" grpc.time_ms=13.882 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 446.804379] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:24.655Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"39ddc01ed6aca945e55352f1","created_at":"2026-08-20T06:00:24.649Z","trace_propagation_headers":{"sentry-trace":"34bc15083a02428d9f548c7d1b074284-7104c94addd14529","baggage":"sentry-trace_id=34bc15083a02428d9f548c7d1b074284,sentry-release=Unknown"},"correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"263eb35ac3791e7afbc611d4","job_size_bytes":46,"pid":3608,"job_status":"deduplicated","message":"ProjectCacheWorker JID-39ddc01ed6aca945e55352f1: deduplicated: until executing","deduplication.type":"until executing"}2109gitlab # [ 446.819099] gitaly[911]: time="2026-08-20T06:00:24.643Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:00:34.254" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:24.625" grpc.time_ms=17.969 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 446.833714] gitaly[911]: time="2026-08-20T06:00:24.709Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T06:00:34.008" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:24.688" grpc.time_ms=20.464 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 446.868711] gitaly[911]: time="2026-08-20T06:00:24.744Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T06:00:54.221" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:24.722" grpc.time_ms=21.996 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 446.913806] gitaly[911]: time="2026-08-20T06:00:24.780Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T06:00:34.078" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T06:00:24.768" grpc.time_ms=11.81 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 446.945336] gitaly[911]: time="2026-08-20T06:00:24.820Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:34.110" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:24.801" grpc.time_ms=19.002 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 447.149366] gitaly[911]: time="2026-08-20T06:00:25.024Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T06:00:35.001" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:25.021" grpc.time_ms=2.774 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 447.188977] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:25.062Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","033d7582398e9bef590efff8854214897015f02b 469e5ce4513aa1d1884c5c76cf26249d4cd34009 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"50ba5d1fb98339c6da142b8b","created_at":"2026-08-20T05:58:54.011Z","trace_propagation_headers":{"sentry-trace":"34bc15083a02428d9f548c7d1b074284-6c21b7483fa74ccb","baggage":"sentry-trace_id=34bc15083a02428d9f548c7d1b074284,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:54.021Z","job_size_bytes":185,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-50ba5d1fb98339c6da142b8b: done: 0.518153 sec","job_status":"done","queue_duration_s":90.522821,"scheduling_latency_s":90.522846,"gitaly_calls":7,"gitaly_duration_s":0.144554,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.041944999999999996,"redis_read_bytes":500,"redis_write_bytes":11940,"redis_cache_calls":9,"redis_cache_duration_s":0.004704,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001992,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5717,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.007144,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.014229,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013876,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.054,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.054,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.330904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00144172,"exclusive_lock_hold_duration_s":0.03603202,"duration_s":0.518153,"completed_at":"2026-08-20T06:00:25.061Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052005,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2116gitlab # [ 447.272302] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:25.067Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fdf3647c624fca8d9cafaabb","created_at":"2026-08-20T05:58:55.762Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-4cb6a4b42c8f4b45","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:55.778Z","job_size_bytes":65,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fdf3647c624fca8d9cafaabb: start","job_status":"start","queue_duration_s":89.289,"scheduling_latency_s":89.289063}2117gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2118gitlab # [ 447.388679] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:25.263Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fdf3647c624fca8d9cafaabb","created_at":"2026-08-20T05:58:55.762Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-4cb6a4b42c8f4b45","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:55.778Z","job_size_bytes":65,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fdf3647c624fca8d9cafaabb: done: 0.19622 sec","job_status":"done","queue_duration_s":89.289,"scheduling_latency_s":89.289063,"redis_calls":16,"redis_duration_s":0.007218,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00357,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002776,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.137811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00094126,"duration_s":0.19622,"completed_at":"2026-08-20T06:00:25.263Z","load_balancing_strategy":"primary","db_duration_s":0.041705,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2119gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.09 seconds)2120gitlab # [ 447.486673] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:25.267Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"369e3943bbc7e4901bffb05f","created_at":"2026-08-20T05:58:55.779Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-4cb6a4b42c8f4b45","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:55.791Z","job_size_bytes":65,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-369e3943bbc7e4901bffb05f: start","job_status":"start","queue_duration_s":89.476344,"scheduling_latency_s":89.47639}2121gitlab # [ 447.510312] nixbot[3627]: INFO: ::ffff:127.0.0.1:45310 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2122gitlab # [ 447.731765] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:25.605Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"369e3943bbc7e4901bffb05f","created_at":"2026-08-20T05:58:55.779Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-4cb6a4b42c8f4b45","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:55.791Z","job_size_bytes":65,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-369e3943bbc7e4901bffb05f: done: 0.337815 sec","job_status":"done","queue_duration_s":89.476344,"scheduling_latency_s":89.47639,"redis_calls":21,"redis_duration_s":0.008302,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.004179,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001993,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.263552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055104,"duration_s":0.337815,"completed_at":"2026-08-20T06:00:25.605Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.061749,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2123gitlab # [ 447.836695] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:25.608Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d8861f7c0e954dcc7122ce20","created_at":"2026-08-20T05:58:56.000Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-4cb6a4b42c8f4b45","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:56.010Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d8861f7c0e954dcc7122ce20: start","job_status":"start","queue_duration_s":89.597447,"scheduling_latency_s":89.597478}2124gitlab # [ 447.993252] gitaly[911]: time="2026-08-20T06:00:25.867Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:25.866" grpc.time_ms=0.691 pid=911 span.kind=server system=grpc2125gitlab # [ 448.038188] gitaly[911]: time="2026-08-20T06:00:25.913Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:25.913" grpc.time_ms=0.612 pid=911 span.kind=server system=grpc2126gitlab # [ 448.086466] gitaly[911]: time="2026-08-20T06:00:25.962Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:25.961" grpc.time_ms=0.873 pid=911 span.kind=server system=grpc2127gitlab # [ 448.115506] gitaly[911]: time="2026-08-20T06:00:25.975Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV diskcache=c027d3b7-0100-4dfc-9fa6-7d28cbbbbe10 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:00:55.308" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:25.809" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 448.136651] gitaly[911]: time="2026-08-20T06:00:25.976Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=181 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7261 command.oublock=0 command.real_time_ms=158 command.spawn_token_fork_ms=1 command.system_time_ms=108 command.user_time_ms=73 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:00:55.308" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:25.809" grpc.time_ms=166.352 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 448.303889] gitaly[911]: time="2026-08-20T06:00:26.179Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:00:56.077" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.177" grpc.time_ms=1.738 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 448.389468] gitaly[911]: time="2026-08-20T06:00:26.265Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0HFZKKS1S88WH6R0SQTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:56.162" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.263" grpc.time_ms=1.427 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2132gitlab # [ 448.435580] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:26.310Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d8861f7c0e954dcc7122ce20","created_at":"2026-08-20T05:58:56.000Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-4cb6a4b42c8f4b45","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:56.010Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d8861f7c0e954dcc7122ce20: done: 0.701954 sec","job_status":"done","queue_duration_s":89.597447,"scheduling_latency_s":89.597478,"gitaly_calls":3,"gitaly_duration_s":0.181703,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.04024,"redis_read_bytes":457,"redis_write_bytes":27999,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001894,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002534,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.013901,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.005802,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14493,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.008856,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000912,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000794,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003653,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.101,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.037,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.042,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.053,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.386502,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6043257400000001,"duration_s":0.701954,"completed_at":"2026-08-20T06:00:26.309Z","load_balancing_strategy":"primary","db_duration_s":0.119824,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2133gitlab # [ 448.527085] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:26.313Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"263eb35ac3791e7afbc611d4","created_at":"2026-08-20T06:00:23.072Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-deec275b40b740bc","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.098Z","job_size_bytes":46,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-263eb35ac3791e7afbc611d4: start","job_status":"start","queue_duration_s":3.2153,"scheduling_latency_s":3.215345}2134gitlab # [ 448.546576] gitaly[911]: time="2026-08-20T06:00:26.414Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T12:00:26.404" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:26.405" grpc.time_ms=8.592 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2135gitlab # [ 448.561891] nixbot[3627]: INFO: ::ffff:127.0.0.1:45322 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2136gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.07 seconds)2137gitlab # [ 448.578829] gitaly[911]: time="2026-08-20T06:00:26.454Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T06:00:56.334" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.435" grpc.time_ms=18.86 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 448.641448] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:26.516Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"263eb35ac3791e7afbc611d4","created_at":"2026-08-20T06:00:23.072Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-deec275b40b740bc","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.098Z","job_size_bytes":46,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-263eb35ac3791e7afbc611d4: done: 0.202628 sec","job_status":"done","queue_duration_s":3.2153,"scheduling_latency_s":3.215345,"gitaly_calls":2,"gitaly_duration_s":0.037902,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.013084,"redis_read_bytes":69,"redis_write_bytes":4882,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002328,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.00096,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002869,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.005242,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001685,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.134554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00072192,"duration_s":0.202628,"completed_at":"2026-08-20T06:00:26.515Z","load_balancing_strategy":"primary","db_duration_s":0.020649,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2139gitlab # [ 448.717870] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:26.519Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"8e10c79eb8121a782213cfda","created_at":"2026-08-20T06:00:23.136Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-deec275b40b740bc","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.148Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-8e10c79eb8121a782213cfda: start","job_status":"start","queue_duration_s":3.370832,"scheduling_latency_s":3.370875}2140gitlab # [ 448.736638] gitaly[911]: time="2026-08-20T06:00:26.608Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y diskcache=02c76d74-6185-4789-9030-5d90de6a9ba7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:26.566" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.567" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 448.747164] gitaly[911]: time="2026-08-20T06:00:26.608Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=47 command.spawn_token_fork_ms=4 command.system_time_ms=18 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:26.566" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.567" grpc.time_ms=41.068 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 448.815755] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:26.689Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"8e10c79eb8121a782213cfda","created_at":"2026-08-20T06:00:23.136Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-deec275b40b740bc","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.148Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-8e10c79eb8121a782213cfda: done: 0.170086 sec","job_status":"done","queue_duration_s":3.370832,"scheduling_latency_s":3.370875,"gitaly_calls":1,"gitaly_duration_s":0.045541,"redis_calls":15,"redis_duration_s":0.00575,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000595,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002104,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001111,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00194,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.024,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.042,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12519392,"duration_s":0.170086,"completed_at":"2026-08-20T06:00:26.689Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030956,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2143gitlab # [ 448.910177] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:26.691Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"080eceaec13e0b25208e8a94","created_at":"2026-08-20T06:00:23.364Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-deec275b40b740bc","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.368Z","job_size_bytes":23,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-080eceaec13e0b25208e8a94: start","job_status":"start","queue_duration_s":3.322963,"scheduling_latency_s":3.322993}2144gitlab # [ 448.927998] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:26.772Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"080eceaec13e0b25208e8a94","created_at":"2026-08-20T06:00:23.364Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-deec275b40b740bc","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:23.368Z","job_size_bytes":23,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-080eceaec13e0b25208e8a94: done: 0.080746 sec","job_status":"done","queue_duration_s":3.322963,"scheduling_latency_s":3.322993,"gitaly_calls":1,"gitaly_duration_s":0.022545,"redis_calls":16,"redis_duration_s":0.005668,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000442,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002535,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001146,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.080746,"completed_at":"2026-08-20T06:00:26.772Z","load_balancing_strategy":"primary","db_duration_s":0.005855,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2145gitlab # [ 448.976037] gitaly[911]: time="2026-08-20T06:00:26.757Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T06:00:56.637" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.738" grpc.time_ms=18.954 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 448.989163] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:26.774Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0d3967b6378d9e74d6828362","created_at":"2026-08-20T06:00:24.191Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-deec275b40b740bc","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3ea26410dc31d8f38b4cbdbbc921ace357ab6149d0a1b7f365e8f372e17b75a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.201Z","job_size_bytes":467,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0d3967b6378d9e74d6828362: start","job_status":"start","queue_duration_s":2.573602,"scheduling_latency_s":2.573634}2147gitlab # [ 449.007375] gitaly[911]: time="2026-08-20T06:00:26.821Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:56.719" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:26.820" grpc.time_ms=1.076 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab # [ 449.020034] gitaly[911]: time="2026-08-20T06:00:26.841Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:00:36.136" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:26.827" grpc.time_ms=14.248 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 449.200291] gitaly[911]: time="2026-08-20T06:00:27.075Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:00:57.073" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:27.074" grpc.time_ms=1.53 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150gitlab # [ 449.238524] gitaly[911]: time="2026-08-20T06:00:27.085Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=28 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T06:00:57.080" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:27.081" grpc.time_ms=4.446 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2151gitlab # [ 449.403242] gitaly[911]: time="2026-08-20T06:00:27.278Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:37.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:27.259" grpc.time_ms=18.966 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2152gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2153gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.07 seconds)2154gitlab # [ 449.633041] nixbot[3627]: INFO: ::ffff:127.0.0.1:45330 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2155gitlab # [ 450.321733] gitaly[911]: time="2026-08-20T06:00:28.196Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:00:58.068" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:28.169" grpc.time_ms=26.857 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 450.353463] gitaly[911]: time="2026-08-20T06:00:28.228Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW07C0SR223QWMC88P9K1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T06:00:58.103" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:28.203" grpc.time_ms=25.165 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 450.408581] sidekiq-cluster[3608]: {"severity":"WARN","time":"2026-08-20T06:00:28.283Z","class":"CreatePipelineWorker","correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"033d7582398e9bef590efff8854214897015f02b","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"033d7582398e9bef590efff8854214897015f02b","ref":"refs/heads/master"},"retry":0}2158gitlab # [ 450.428403] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:28.295Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0d3967b6378d9e74d6828362","created_at":"2026-08-20T06:00:24.191Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-deec275b40b740bc","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3ea26410dc31d8f38b4cbdbbc921ace357ab6149d0a1b7f365e8f372e17b75a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.201Z","job_size_bytes":467,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0d3967b6378d9e74d6828362: done: 1.520369 sec","job_status":"done","queue_duration_s":2.573602,"scheduling_latency_s":2.573634,"gitaly_calls":7,"gitaly_duration_s":0.121617,"redis_calls":51,"redis_duration_s":0.016243,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.00149,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.007341,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004066,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001563,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.31058,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052462,"duration_s":1.520369,"completed_at":"2026-08-20T06:00:28.295Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.098688,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2159gitlab # [ 450.500169] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:28.298Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"8a37cfb0-df94-4026-976a-3b37968200ff\"}"],"class":"WebHookWorker","jid":"96991fdd855a2d8e5e3d9538","created_at":"2026-08-20T06:00:24.445Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-deec275b40b740bc","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:48e86b02dad06e62d2f3fe8fa6c8e86c8c2359820a960daadda4b2ad5efe124b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.453Z","job_size_bytes":1751,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-96991fdd855a2d8e5e3d9538: start","job_status":"start","queue_duration_s":3.844369,"scheduling_latency_s":3.844402}2160gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2161gitlab # [ 450.681615] nixbot[3627]: INFO: ::ffff:127.0.0.1:45332 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2162gitlab # [ 450.691548] nixbot[3627]: INFO: ::ffff:127.0.0.1:45344 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2163gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.06 seconds)2164gitlab # [ 450.726829] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:28.601Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"8a37cfb0-df94-4026-976a-3b37968200ff\"}"],"class":"WebHookWorker","jid":"96991fdd855a2d8e5e3d9538","created_at":"2026-08-20T06:00:24.445Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-deec275b40b740bc","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:48e86b02dad06e62d2f3fe8fa6c8e86c8c2359820a960daadda4b2ad5efe124b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.453Z","job_size_bytes":1751,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-96991fdd855a2d8e5e3d9538: done: 0.302902 sec","job_status":"done","queue_duration_s":3.844369,"scheduling_latency_s":3.844402,"redis_calls":19,"redis_duration_s":0.007734,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002079,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.00069,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003133,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001832,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09393203999997013,"cpu_s":0.184773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00075406,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.302902,"completed_at":"2026-08-20T06:00:28.600Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165gitlab # [ 450.840381] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:28.606Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"cfe6ab814466a8115b9b7f15","created_at":"2026-08-20T06:00:24.671Z","trace_propagation_headers":{"sentry-trace":"34bc15083a02428d9f548c7d1b074284-7104c94addd14529","baggage":"sentry-trace_id=34bc15083a02428d9f548c7d1b074284,sentry-release=Unknown"},"correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"8e10c79eb8121a782213cfda","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.678Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-cfe6ab814466a8115b9b7f15: start","job_status":"start","queue_duration_s":3.927011,"scheduling_latency_s":3.927061}2166gitlab # [ 450.863309] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:28.698Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"cfe6ab814466a8115b9b7f15","created_at":"2026-08-20T06:00:24.671Z","trace_propagation_headers":{"sentry-trace":"34bc15083a02428d9f548c7d1b074284-7104c94addd14529","baggage":"sentry-trace_id=34bc15083a02428d9f548c7d1b074284,sentry-release=Unknown"},"correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"8e10c79eb8121a782213cfda","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.678Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-cfe6ab814466a8115b9b7f15: done: 0.092996 sec","job_status":"done","queue_duration_s":3.927011,"scheduling_latency_s":3.927061,"gitaly_calls":1,"gitaly_duration_s":0.017331,"redis_calls":12,"redis_duration_s":0.003863,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001529,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000756,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001578,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05067606,"duration_s":0.092996,"completed_at":"2026-08-20T06:00:28.698Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2167gitlab # [ 450.911292] gitaly[911]: time="2026-08-20T06:00:28.662Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS diskcache=20b248d0-33cf-4116-8eb9-c75799dc3e57 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:28.649" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:28.650" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab # [ 450.921436] gitaly[911]: time="2026-08-20T06:00:28.663Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:28.649" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:28.650" grpc.time_ms=12.982 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 450.935076] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:28.702Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0137dd06cdf1e3145bb4ba3e","created_at":"2026-08-20T06:00:24.942Z","trace_propagation_headers":{"sentry-trace":"34bc15083a02428d9f548c7d1b074284-7104c94addd14529","baggage":"sentry-trace_id=34bc15083a02428d9f548c7d1b074284,sentry-release=Unknown"},"correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:61155cf4e8b6cf4792543b8ad248c94e7c8a304b4f5200a95fc9cbc396b7d28c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.948Z","job_size_bytes":467,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0137dd06cdf1e3145bb4ba3e: start","job_status":"start","queue_duration_s":3.754119,"scheduling_latency_s":3.754152}2170gitlab # [ 450.953466] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1812171gitlab # [ 450.955620] gitaly[911]: time="2026-08-20T06:00:28.741Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:58.639" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:28.739" grpc.time_ms=1.577 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 450.968622] gitaly[911]: time="2026-08-20T06:00:28.756Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:00:38.064" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:28.745" grpc.time_ms=11.235 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab # [ 450.981871] gitaly[911]: time="2026-08-20T06:00:28.796Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3CP8FN2N6FVD0CBS15B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.780" grpc.time_ms=15.314 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2174gitlab # [ 450.995238] gitaly[911]: time="2026-08-20T06:00:28.803Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:00:58.701" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:28.802" grpc.time_ms=1.018 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 451.009443] gitaly[911]: time="2026-08-20T06:00:28.811Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=42 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T06:00:58.707" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:28.808" grpc.time_ms=3.355 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 451.025474] gitaly[911]: time="2026-08-20T06:00:28.884Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:38.188" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:28.870" grpc.time_ms=14.117 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 451.047385] gitaly[911]: time="2026-08-20T06:00:28.923Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3CW0Q5Q3S6D7FZQ5W6SQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.911" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2178gitlab # [ 451.058258] gitaly[911]: time="2026-08-20T06:00:28.923Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3CW0Q5Q3S6D7FZQ5W6SQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.911" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2179gitlab # [ 451.072074] gitlab-workhorse[817]: time="2026-08-20T06:00:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672180gitlab # [ 451.073929] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1232181gitlab # [ 451.075823] gitaly[911]: time="2026-08-20T06:00:28.923Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3CW0Q5Q3S6D7FZQ5W6SQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:28.911" grpc.time_ms=12.168 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2182gitlab # [ 451.098052] nixbot[3627]: {"ts": "2026-08-20T06:00:28.973Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2183gitlab # [ 451.221177] gitaly[911]: time="2026-08-20T06:00:29.096Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3D28BPMASDCQC9ZTXA5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:59.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:29.095" grpc.time_ms=1.318 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 451.313448] gitaly[911]: time="2026-08-20T06:00:29.189Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3D28BPMASDCQC9ZTXA5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:39.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:29.173" grpc.time_ms=15.751 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2185gitlab # [ 451.390308] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2642186gitlab # [ 451.398812] nixbot[3627]: {"ts": "2026-08-20T06:00:29.270Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}2187gitlab # [ 451.527838] gitaly[911]: time="2026-08-20T06:00:29.402Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3DBC52ZW09VA56XH6CTX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:59.100" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:29.401" grpc.time_ms=1.071 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188gitlab # [ 451.629867] gitaly[911]: time="2026-08-20T06:00:29.505Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3DBC52ZW09VA56XH6CTX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:39.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:29.485" grpc.time_ms=19.204 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2190gitlab # [ 451.705970] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2882191gitlab # [ 451.715063] nixbot[3627]: {"ts": "2026-08-20T06:00:29.583Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}2192gitlab # [ 451.765093] nixbot[3627]: INFO: ::ffff:127.0.0.1:40188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2193gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.07 seconds)2194gitlab # [ 451.789476] gitaly[911]: time="2026-08-20T06:00:29.664Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=5 command.system_time_ms=14 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:00:59.538" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:29.639" grpc.time_ms=25.557 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2195gitlab # [ 451.817168] gitaly[911]: time="2026-08-20T06:00:29.672Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3DMVS7PNMAHYYTE5VV63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:00:59.070" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:29.670" grpc.time_ms=1.592 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196gitlab # [ 451.838947] gitaly[911]: time="2026-08-20T06:00:29.692Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0FK4P0K9BDVVRGTSN2GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T06:00:59.567" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:29.668" grpc.time_ms=23.533 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 451.859260] sidekiq-cluster[3608]: {"severity":"WARN","time":"2026-08-20T06:00:29.713Z","class":"CreatePipelineWorker","correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"033d7582398e9bef590efff8854214897015f02b","after":"469e5ce4513aa1d1884c5c76cf26249d4cd34009","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"469e5ce4513aa1d1884c5c76cf26249d4cd34009","ref":"refs/heads/master"},"retry":0}2198gitlab # [ 451.868449] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:29.721Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0137dd06cdf1e3145bb4ba3e","created_at":"2026-08-20T06:00:24.942Z","trace_propagation_headers":{"sentry-trace":"34bc15083a02428d9f548c7d1b074284-7104c94addd14529","baggage":"sentry-trace_id=34bc15083a02428d9f548c7d1b074284,sentry-release=Unknown"},"correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:61155cf4e8b6cf4792543b8ad248c94e7c8a304b4f5200a95fc9cbc396b7d28c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.948Z","job_size_bytes":467,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0137dd06cdf1e3145bb4ba3e: done: 1.018801 sec","job_status":"done","queue_duration_s":3.754119,"scheduling_latency_s":3.754152,"gitaly_calls":7,"gitaly_duration_s":0.107339,"redis_calls":33,"redis_duration_s":0.007914,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000831,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004181,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001372,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.88642,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.018801,"completed_at":"2026-08-20T06:00:29.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02987,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2199gitlab # [ 451.925810] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:29.724Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"d64e8d1a-4275-49af-bf9e-6ab133e3f229\"}"],"class":"WebHookWorker","jid":"38ab0030a7a52f8c2c580cff","created_at":"2026-08-20T06:00:24.985Z","trace_propagation_headers":{"sentry-trace":"34bc15083a02428d9f548c7d1b074284-7104c94addd14529","baggage":"sentry-trace_id=34bc15083a02428d9f548c7d1b074284,sentry-release=Unknown"},"correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:44a3ee570e55cdf8685b4d4a9f334fccefd09bb077b8ed7b4aef280c5c0e6d41","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.991Z","job_size_bytes":1749,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-38ab0030a7a52f8c2c580cff: start","job_status":"start","queue_duration_s":4.732671,"scheduling_latency_s":4.732705}2200gitlab # [ 451.944264] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:29.777Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"d64e8d1a-4275-49af-bf9e-6ab133e3f229\"}"],"class":"WebHookWorker","jid":"38ab0030a7a52f8c2c580cff","created_at":"2026-08-20T06:00:24.985Z","trace_propagation_headers":{"sentry-trace":"34bc15083a02428d9f548c7d1b074284-7104c94addd14529","baggage":"sentry-trace_id=34bc15083a02428d9f548c7d1b074284,sentry-release=Unknown"},"correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:44a3ee570e55cdf8685b4d4a9f334fccefd09bb077b8ed7b4aef280c5c0e6d41","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:24.991Z","job_size_bytes":1749,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-38ab0030a7a52f8c2c580cff: done: 0.053428 sec","job_status":"done","queue_duration_s":4.732671,"scheduling_latency_s":4.732705,"redis_calls":14,"redis_duration_s":0.007004,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000318,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002307,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004379,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.008379320000017287,"cpu_s":0.030109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.053428,"completed_at":"2026-08-20T06:00:29.777Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003166,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2201gitlab # [ 451.992463] nixbot[3627]: INFO: ::ffff:127.0.0.1:40198 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2202gitlab # [ 451.993725] nixbot[3627]: {"ts": "2026-08-20T06:00:29.835Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b \"HTTP/1.1 201 Created\""}2203gitlab # [ 451.996491] gitaly[911]: time="2026-08-20T06:00:29.759Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3DMVS7PNMAHYYTE5VV63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:39.262" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:29.743" grpc.time_ms=16.006 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 452.010097] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:29.779Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"97531795082d286f906c8762","created_at":"2026-08-20T06:00:25.786Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:25.793Z","job_size_bytes":23,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-97531795082d286f906c8762: start","job_status":"start","queue_duration_s":3.985716,"scheduling_latency_s":3.98574}2205gitlab # [ 452.027242] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/033d7582398e9bef590efff8854214897015f02b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2382206gitlab # [ 452.030976] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 662207gitlab # [ 452.033103] gitaly[911]: time="2026-08-20T06:00:29.872Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3DVEJH1YKX8VH9FQ4FV9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:29.860" grpc.time_ms=11.726 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2208gitlab # [ 452.046560] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:29.904Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"97531795082d286f906c8762","created_at":"2026-08-20T06:00:25.786Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:25.793Z","job_size_bytes":23,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-97531795082d286f906c8762: done: 0.125056 sec","job_status":"done","queue_duration_s":3.985716,"scheduling_latency_s":3.98574,"redis_calls":10,"redis_duration_s":0.004363,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002583,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001375,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029342,"duration_s":0.125056,"completed_at":"2026-08-20T06:00:29.904Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024676,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2209gitlab # [ 452.091645] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:29.906Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"87524bf212c8e4f5f6ec8454","created_at":"2026-08-20T06:00:25.986Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:25.998Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-87524bf212c8e4f5f6ec8454: start","job_status":"start","queue_duration_s":3.907406,"scheduling_latency_s":3.90743}2210gitlab # [ 452.108810] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:29.954Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"87524bf212c8e4f5f6ec8454","created_at":"2026-08-20T06:00:25.986Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:25.998Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-87524bf212c8e4f5f6ec8454: done: 0.048268 sec","job_status":"done","queue_duration_s":3.907406,"scheduling_latency_s":3.90743,"redis_calls":10,"redis_duration_s":0.002777,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001116,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032118,"duration_s":0.048268,"completed_at":"2026-08-20T06:00:29.954Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2211gitlab # [ 452.155132] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:29.956Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"618d121dd569bcf7cc81d511","created_at":"2026-08-20T06:00:26.025Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.038Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-618d121dd569bcf7cc81d511: start","job_status":"start","queue_duration_s":3.918463,"scheduling_latency_s":3.918487}2212gitlab # [ 452.171446] gitlab-workhorse[817]: time="2026-08-20T06:00:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672213gitlab # [ 452.173451] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 762214gitlab # [ 452.175400] gitaly[911]: time="2026-08-20T06:00:29.949Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3DXJ19BD9YZD6S1PVNR6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:29.932" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2215gitlab # [ 452.185962] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.007Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"618d121dd569bcf7cc81d511","created_at":"2026-08-20T06:00:26.025Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.038Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-618d121dd569bcf7cc81d511: done: 0.0507 sec","job_status":"done","queue_duration_s":3.918463,"scheduling_latency_s":3.918487,"redis_calls":10,"redis_duration_s":0.003882,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001039,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024738,"duration_s":0.0507,"completed_at":"2026-08-20T06:00:30.007Z","load_balancing_strategy":"primary","db_duration_s":0.008897,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2216gitlab # [ 452.230395] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.013Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2b23ee8ffd4787a20b08a07d","created_at":"2026-08-20T06:00:26.064Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.073Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2b23ee8ffd4787a20b08a07d: start","job_status":"start","queue_duration_s":3.939827,"scheduling_latency_s":3.939852}2217gitlab # [ 452.247661] nix-daemon[3857]: accepted connection from pid 4434, user nixbot2218gitlab # [ 452.248717] gitaly[911]: time="2026-08-20T06:00:29.950Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3DXJ19BD9YZD6S1PVNR6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:29.932" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2219gitlab # [ 452.262320] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.060Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2b23ee8ffd4787a20b08a07d","created_at":"2026-08-20T06:00:26.064Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.073Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2b23ee8ffd4787a20b08a07d: done: 0.046876 sec","job_status":"done","queue_duration_s":3.939827,"scheduling_latency_s":3.939852,"redis_calls":13,"redis_duration_s":0.00315,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000758,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000847,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035692,"duration_s":0.046876,"completed_at":"2026-08-20T06:00:30.060Z","load_balancing_strategy":"primary","db_duration_s":0.006075,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2220gitlab # [ 452.308181] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.062Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6c1bd361dd1d25927d800583","created_at":"2026-08-20T06:00:26.074Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.084Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6c1bd361dd1d25927d800583: start","job_status":"start","queue_duration_s":3.97792,"scheduling_latency_s":3.977947}2221gitlab # [ 452.324655] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1042222gitlab # [ 452.326709] gitlab-workhorse[817]: time="2026-08-20T06:00:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672223gitlab # [ 452.328622] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 842224gitlab # [ 452.330506] gitaly[911]: time="2026-08-20T06:00:29.950Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3DXJ19BD9YZD6S1PVNR6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:29.932" grpc.time_ms=17.695 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2225gitlab # [ 452.345300] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.103Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6c1bd361dd1d25927d800583","created_at":"2026-08-20T06:00:26.074Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.084Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6c1bd361dd1d25927d800583: done: 0.040882 sec","job_status":"done","queue_duration_s":3.97792,"scheduling_latency_s":3.977947,"redis_calls":10,"redis_duration_s":0.0018139999999999999,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000419,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026116,"duration_s":0.040882,"completed_at":"2026-08-20T06:00:30.103Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2226gitlab # [ 452.390574] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.105Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c594a4092364bbef626f3152","created_at":"2026-08-20T06:00:26.085Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.093Z","job_size_bytes":19,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c594a4092364bbef626f3152: start","job_status":"start","queue_duration_s":4.011043,"scheduling_latency_s":4.011064}2227gitlab # [ 452.407264] gitaly[911]: time="2026-08-20T06:00:30.110Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3E1PS2DF3QJA122EQJ6K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:30.099" grpc.time_ms=11 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2228gitlab # [ 452.420797] gitaly[911]: time="2026-08-20T06:00:30.196Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3E50D9M9QY1HXX9VAEC5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:30.178" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2229gitlab # [ 452.430906] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.138Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c594a4092364bbef626f3152","created_at":"2026-08-20T06:00:26.085Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.093Z","job_size_bytes":19,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c594a4092364bbef626f3152: done: 0.033588 sec","job_status":"done","queue_duration_s":4.011043,"scheduling_latency_s":4.011064,"redis_calls":11,"redis_duration_s":0.0015069999999999999,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024056,"duration_s":0.033588,"completed_at":"2026-08-20T06:00:30.138Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2230gitlab # [ 452.478468] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.139Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"6ccedc10cb148f31f4dff59e","created_at":"2026-08-20T06:00:26.098Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.107Z","job_size_bytes":66,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-6ccedc10cb148f31f4dff59e: start","job_status":"start","queue_duration_s":4.032435,"scheduling_latency_s":4.032453}2231gitlab # [ 452.496842] gitaly[911]: time="2026-08-20T06:00:30.196Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3E50D9M9QY1HXX9VAEC5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:30.178" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2232gitlab # [ 452.510706] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1012233gitlab # [ 452.512977] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.175Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"6ccedc10cb148f31f4dff59e","created_at":"2026-08-20T06:00:26.098Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.107Z","job_size_bytes":66,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-6ccedc10cb148f31f4dff59e: done: 0.035254 sec","job_status":"done","queue_duration_s":4.032435,"scheduling_latency_s":4.032453,"redis_calls":10,"redis_duration_s":0.0014449999999999999,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000312,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024926,"duration_s":0.035254,"completed_at":"2026-08-20T06:00:30.175Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004516,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 452.560451] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.177Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"142b09918231f5272cc6a1d9","created_at":"2026-08-20T06:00:26.108Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.115Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-142b09918231f5272cc6a1d9: start","job_status":"start","queue_duration_s":4.061673,"scheduling_latency_s":4.061695}2235gitlab # [ 452.577707] gitaly[911]: time="2026-08-20T06:00:30.196Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3E50D9M9QY1HXX9VAEC5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:30.178" grpc.time_ms=18.533 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2236gitlab # [ 452.592758] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.248Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"142b09918231f5272cc6a1d9","created_at":"2026-08-20T06:00:26.108Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.115Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-142b09918231f5272cc6a1d9: done: 0.071682 sec","job_status":"done","queue_duration_s":4.061673,"scheduling_latency_s":4.061695,"redis_calls":10,"redis_duration_s":0.001715,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000381,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":10,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002929,"duration_s":0.071682,"completed_at":"2026-08-20T06:00:30.248Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2237gitlab # [ 452.640358] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.250Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"cc796dd794727b118587322c","created_at":"2026-08-20T06:00:26.124Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.132Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-cc796dd794727b118587322c: start","job_status":"start","queue_duration_s":4.118212,"scheduling_latency_s":4.118235}2238gitlab # [ 452.658128] gitaly[911]: time="2026-08-20T06:00:30.366Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3E9SC18REZ1VD6GZG1TR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:30.350" grpc.time_ms=15.846 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2239gitlab # [ 452.671581] gitaly[911]: time="2026-08-20T06:00:30.473Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3ED08NS29T7GTNG4QZ06 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:30.447" pid=911 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2240gitlab # [ 452.682164] gitlab-workhorse[817]: time="2026-08-20T06:00:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162241gitlab # [ 452.684054] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1062242gitlab # [ 452.685964] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.296Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"cc796dd794727b118587322c","created_at":"2026-08-20T06:00:26.124Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.132Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-cc796dd794727b118587322c: done: 0.045653 sec","job_status":"done","queue_duration_s":4.118212,"scheduling_latency_s":4.118235,"redis_calls":10,"redis_duration_s":0.001999,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000448,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031096,"duration_s":0.045653,"completed_at":"2026-08-20T06:00:30.296Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2243gitlab # [ 452.731086] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.297Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d7fdc12b8ca7e0a9ab0277e1","created_at":"2026-08-20T06:00:26.133Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.138Z","job_size_bytes":6,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d7fdc12b8ca7e0a9ab0277e1: start","job_status":"start","queue_duration_s":4.158913,"scheduling_latency_s":4.158933}2244gitlab # [ 452.746979] gitaly[911]: time="2026-08-20T06:00:30.473Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3ED08NS29T7GTNG4QZ06 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:30.447" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2245gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009'2246gitlab # [ 452.760943] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.327Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d7fdc12b8ca7e0a9ab0277e1","created_at":"2026-08-20T06:00:26.133Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.138Z","job_size_bytes":6,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d7fdc12b8ca7e0a9ab0277e1: done: 0.029826 sec","job_status":"done","queue_duration_s":4.158913,"scheduling_latency_s":4.158933,"redis_calls":10,"redis_duration_s":0.002404,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000417,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000576,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036636,"duration_s":0.029826,"completed_at":"2026-08-20T06:00:30.327Z","load_balancing_strategy":"primary","db_duration_s":0.003752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2247gitlab # [ 452.802566] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.329Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"7b0afa929e48237ba9bd63a0","created_at":"2026-08-20T06:00:26.139Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.145Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7b0afa929e48237ba9bd63a0: start","job_status":"start","queue_duration_s":4.184166,"scheduling_latency_s":4.184186}2248gitlab # [ 452.817691] gitaly[911]: time="2026-08-20T06:00:30.482Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3ED08NS29T7GTNG4QZ06 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:30.447" grpc.time_ms=26.911 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2249gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009', in 0.09 seconds)2250(finished: subtest: push delivers the webhook, in 97.73 seconds)2251subtest: eval and build post commit statuses2252gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses2253gitlab # [ 452.832758] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.403Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"7b0afa929e48237ba9bd63a0","created_at":"2026-08-20T06:00:26.139Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.145Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7b0afa929e48237ba9bd63a0: done: 0.073969 sec","job_status":"done","queue_duration_s":4.184166,"scheduling_latency_s":4.184186,"redis_calls":10,"redis_duration_s":0.0028469999999999997,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000634,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001617,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057314,"duration_s":0.073969,"completed_at":"2026-08-20T06:00:30.403Z","load_balancing_strategy":"primary","db_duration_s":0.017068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2254gitlab # [ 452.878932] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.405Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"786da826337379ac9febf834","created_at":"2026-08-20T06:00:26.154Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.161Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-786da826337379ac9febf834: start","job_status":"start","queue_duration_s":4.244235,"scheduling_latency_s":4.244265}2255gitlab # [ 452.896921] gitaly[911]: time="2026-08-20T06:00:30.635Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:00.033" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:30.634" grpc.time_ms=0.818 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 452.911439] nixbot[3627]: INFO: ::ffff:127.0.0.1:40212 - "GET /api/repos/gitlab/root/test-flake/builds?commit=469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 200 OK2257gitlab # [ 452.913713] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.508Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"786da826337379ac9febf834","created_at":"2026-08-20T06:00:26.154Z","trace_propagation_headers":{"sentry-trace":"c59f01598f9143149252361f642241f0-ae2c59e10a2d4c5a","baggage":"sentry-trace_id=c59f01598f9143149252361f642241f0,sentry-release=Unknown"},"correlation_id":"01M0EW0HFZKKS1S88WH6R0SQTV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.161Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-786da826337379ac9febf834: done: 0.103196 sec","job_status":"done","queue_duration_s":4.244235,"scheduling_latency_s":4.244265,"redis_calls":14,"redis_duration_s":0.006314,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002033,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002248,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002033,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003011,"duration_s":0.103196,"completed_at":"2026-08-20T06:00:30.508Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2258gitlab # [ 452.962118] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.510Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"1b4a88c49e73653596e48b49","created_at":"2026-08-20T06:00:26.476Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-dcb447ae3e674e43","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.488Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-1b4a88c49e73653596e48b49: start","job_status":"start","queue_duration_s":4.021935,"scheduling_latency_s":4.021967}2259gitlab # [ 452.978846] gitaly[911]: time="2026-08-20T06:00:30.667Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T06:01:00.050" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:30.651" grpc.time_ms=15.868 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2260gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses, in 0.14 seconds)2261gitlab # [ 452.993797] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.581Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"1b4a88c49e73653596e48b49","created_at":"2026-08-20T06:00:26.476Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-dcb447ae3e674e43","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:26.488Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-1b4a88c49e73653596e48b49: done: 0.07115 sec","job_status":"done","queue_duration_s":4.021935,"scheduling_latency_s":4.021967,"redis_calls":19,"redis_duration_s":0.0066960000000000006,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001213,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.001832,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002469,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001182,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01343448,"duration_s":0.07115,"completed_at":"2026-08-20T06:00:30.581Z","load_balancing_strategy":"primary","db_duration_s":0.009507,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2262gitlab # [ 453.041655] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.583Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","96991fdd855a2d8e5e3d9538"],"class":"WebHooks::LogExecutionWorker","jid":"2a9916eb574263f21d0a6317","created_at":"2026-08-20T06:00:28.563Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-852c97701d56405a","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cde952f7b7faff5e5775e2e4d7a975db5048883ce6d2283da956d32be470745a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.579Z","job_size_bytes":2593,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2a9916eb574263f21d0a6317: start","job_status":"start","queue_duration_s":2.004332,"scheduling_latency_s":2.004359}2263gitlab # [ 453.060579] gitaly[911]: time="2026-08-20T06:00:30.701Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:40.200" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:30.680" grpc.time_ms=20.071 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2264gitlab # [ 453.075425] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 952265gitlab # [ 453.078346] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.657Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","96991fdd855a2d8e5e3d9538"],"class":"WebHooks::LogExecutionWorker","jid":"2a9916eb574263f21d0a6317","created_at":"2026-08-20T06:00:28.563Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-852c97701d56405a","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cde952f7b7faff5e5775e2e4d7a975db5048883ce6d2283da956d32be470745a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:28.579Z","job_size_bytes":2593,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2a9916eb574263f21d0a6317: done: 0.073537 sec","job_status":"done","queue_duration_s":2.004332,"scheduling_latency_s":2.004359,"redis_calls":10,"redis_duration_s":0.004829,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000923,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000661,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052852,"duration_s":0.073537,"completed_at":"2026-08-20T06:00:30.657Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2266gitlab # [ 453.124778] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.660Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5330aabf9f0473d0c1eef69e","created_at":"2026-08-20T06:00:29.233Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-e900716a62d54c40","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:29.240Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5330aabf9f0473d0c1eef69e: start","job_status":"start","queue_duration_s":1.419568,"scheduling_latency_s":1.419601}2267gitlab # [ 453.141097] gitaly[911]: time="2026-08-20T06:00:30.760Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:00:40.279" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:30.759" grpc.time_ms=0.541 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2268gitlab # [ 453.152284] nixbot[3627]: {"ts": "2026-08-20T06:00:31.007Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/469e5ce4513aa1d1884c5c76cf26249d4cd34009 \"HTTP/1.1 201 Created\""}2269gitlab # [ 453.155797] nixbot[3627]: {"ts": "2026-08-20T06:00:31.016Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-469e5ce4513a-4"}2270gitlab # [ 453.158424] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.984Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5330aabf9f0473d0c1eef69e","created_at":"2026-08-20T06:00:29.233Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-e900716a62d54c40","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:29.240Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3608,"job_status":"rescheduled","message":"PipelineProcessWorker JID-5330aabf9f0473d0c1eef69e: rescheduled"}2271gitlab # [ 453.173825] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.992Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5330aabf9f0473d0c1eef69e","created_at":"2026-08-20T06:00:29.233Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-e900716a62d54c40","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:29.240Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5330aabf9f0473d0c1eef69e: done: 0.332037 sec","job_status":"done","queue_duration_s":1.419568,"scheduling_latency_s":1.419601,"gitaly_calls":3,"gitaly_duration_s":0.118731,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.017488,"redis_read_bytes":150,"redis_write_bytes":18016,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000913,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001366,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002704,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12315,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004777,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000384,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001983,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.004448,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.165059,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.27028612,"duration_s":0.332037,"completed_at":"2026-08-20T06:00:30.992Z","load_balancing_strategy":"primary","db_duration_s":0.037149,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2272gitlab # [ 453.226290] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4792273gitlab # [ 453.228940] gitaly[911]: time="2026-08-20T06:00:30.781Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:00:40.287" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:30.768" grpc.time_ms=13.105 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab # [ 453.242946] gitaly[911]: time="2026-08-20T06:00:30.812Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3D28BPMASDCQC9ZTXA5T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:30.810" grpc.time_ms=0.794 pid=911 span.kind=server system=grpc2275gitlab # [ 453.253062] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:30.993Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","38ab0030a7a52f8c2c580cff"],"class":"WebHooks::LogExecutionWorker","jid":"898af103461b1cd791b0e927","created_at":"2026-08-20T06:00:29.762Z","trace_propagation_headers":{"sentry-trace":"34bc15083a02428d9f548c7d1b074284-70f2f418745b4d26","baggage":"sentry-trace_id=34bc15083a02428d9f548c7d1b074284,sentry-release=Unknown"},"correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b4eb73bea2d5e1e6ebf33df7f5025a01009d7bba9932a9c890a8375a070c5313","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:29.766Z","job_size_bytes":2592,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-898af103461b1cd791b0e927: start","job_status":"start","queue_duration_s":1.227583,"scheduling_latency_s":1.227607}2276gitlab # [ 453.271384] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.025Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","38ab0030a7a52f8c2c580cff"],"class":"WebHooks::LogExecutionWorker","jid":"898af103461b1cd791b0e927","created_at":"2026-08-20T06:00:29.762Z","trace_propagation_headers":{"sentry-trace":"34bc15083a02428d9f548c7d1b074284-70f2f418745b4d26","baggage":"sentry-trace_id=34bc15083a02428d9f548c7d1b074284,sentry-release=Unknown"},"correlation_id":"01M0EW0FK4P0K9BDVVRGTSN2GS","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b4eb73bea2d5e1e6ebf33df7f5025a01009d7bba9932a9c890a8375a070c5313","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:29.766Z","job_size_bytes":2592,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-898af103461b1cd791b0e927: done: 0.031257 sec","job_status":"done","queue_duration_s":1.227583,"scheduling_latency_s":1.227607,"redis_calls":7,"redis_duration_s":0.003319,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002917,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000402,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031257,"completed_at":"2026-08-20T06:00:31.024Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003512,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2277gitlab # [ 453.315499] nix-daemon[3857]: accepted connection from pid 4528, user nixbot2278gitlab # [ 453.316503] nix-daemon[3857]: accepted connection from pid 4536, user nixbot2279gitlab # [ 453.317443] gitaly[911]: time="2026-08-20T06:00:30.836Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3D28BPMASDCQC9ZTXA5T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:30.836" grpc.time_ms=0.375 pid=911 span.kind=server system=grpc2280gitlab # [ 453.327270] gitaly[911]: time="2026-08-20T06:00:30.841Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3ESTCJ0Z0ECR5K3981NH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:00.539" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:30.839" grpc.time_ms=1.495 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2281gitlab # [ 453.340384] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.026Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"2a53f6de8baac37f05b44292","created_at":"2026-08-20T06:00:30.560Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-6355a58b37954e71","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.568Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-2a53f6de8baac37f05b44292: start","job_status":"start","queue_duration_s":0.45831,"scheduling_latency_s":0.458335}2282gitlab # [ 453.357516] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.156Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"2a53f6de8baac37f05b44292","created_at":"2026-08-20T06:00:30.560Z","trace_propagation_headers":{"sentry-trace":"35b8ba2316be4f7a8f2e881832822c6f-6355a58b37954e71","baggage":"sentry-trace_id=35b8ba2316be4f7a8f2e881832822c6f,sentry-release=Unknown"},"correlation_id":"01M0EW07C0SR223QWMC88P9K1Y","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.568Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-2a53f6de8baac37f05b44292: done: 0.130132 sec","job_status":"done","queue_duration_s":0.45831,"scheduling_latency_s":0.458335,"redis_calls":11,"redis_duration_s":0.003476,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000361,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002557,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061092,"duration_s":0.130132,"completed_at":"2026-08-20T06:00:31.156Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2283gitlab # [ 453.403425] nixbot[3627]: {"ts": "2026-08-20T06:00:31.193Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-469e5ce4513a-4", "argv0": "bwrap"}2284gitlab # [ 453.411118] gitaly[911]: time="2026-08-20T06:00:30.846Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:30.846" grpc.time_ms=0.395 pid=911 span.kind=server system=grpc2285gitlab # [ 453.439664] gitaly[911]: time="2026-08-20T06:00:30.865Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3D28BPMASDCQC9ZTXA5T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:30.864" grpc.time_ms=0.4 pid=911 span.kind=server system=grpc2286gitlab # [ 453.460784] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.159Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"47c697627869c14146ccec81","created_at":"2026-08-20T06:00:30.753Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.756Z","job_size_bytes":23,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-47c697627869c14146ccec81: start","job_status":"start","queue_duration_s":0.4029,"scheduling_latency_s":0.402983}2287gitlab # [ 453.489441] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.229Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"47c697627869c14146ccec81","created_at":"2026-08-20T06:00:30.753Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.756Z","job_size_bytes":23,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-47c697627869c14146ccec81: done: 0.069422 sec","job_status":"done","queue_duration_s":0.4029,"scheduling_latency_s":0.402983,"redis_calls":7,"redis_duration_s":0.002982,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000634,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.069422,"completed_at":"2026-08-20T06:00:31.229Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012587,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2288gitlab # [ 453.543891] gitaly[911]: time="2026-08-20T06:00:30.873Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3D28BPMASDCQC9ZTXA5T diskcache=ed7aae9d-c65b-45a5-abd8-eaf53ca2e13e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:00.664" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:30.765" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2289gitlab # [ 453.554307] gitaly[911]: time="2026-08-20T06:00:30.873Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=85 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6953 command.oublock=0 command.real_time_ms=102 command.spawn_token_fork_ms=1 command.system_time_ms=59 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3D28BPMASDCQC9ZTXA5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:00.664" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:30.765" grpc.time_ms=108.162 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2290gitlab # [ 453.568619] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.231Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f78bd21b035239d2595bb4fc","created_at":"2026-08-20T06:00:30.879Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.884Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f78bd21b035239d2595bb4fc: start","job_status":"start","queue_duration_s":0.346595,"scheduling_latency_s":0.346622}2291gitlab # [ 453.585180] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.266Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f78bd21b035239d2595bb4fc","created_at":"2026-08-20T06:00:30.879Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.884Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f78bd21b035239d2595bb4fc: done: 0.03578 sec","job_status":"done","queue_duration_s":0.346595,"scheduling_latency_s":0.346622,"redis_calls":7,"redis_duration_s":0.0020099999999999996,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03578,"completed_at":"2026-08-20T06:00:31.266Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008087,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2292gitlab # [ 453.628787] gitaly[911]: time="2026-08-20T06:00:30.880Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:30.879" grpc.time_ms=0.46 pid=911 span.kind=server system=grpc2293gitlab # [ 453.638654] gitaly[911]: time="2026-08-20T06:00:30.887Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP diskcache=f3d7b61f-36fc-4806-b263-51ec4f811053 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:40.006" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:30.786" pid=911 ref=refs/keep-around/469e5ce4513aa1d1884c5c76cf26249d4cd34009 remote_ip="2001:db8:1::1" revision=469e5ce4513aa1d1884c5c76cf26249d4cd34009 span.kind=server system=grpc username=root2294gitlab # [ 453.650661] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.268Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a9499faed8db475b67bd08a8","created_at":"2026-08-20T06:00:30.893Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.896Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a9499faed8db475b67bd08a8: start","job_status":"start","queue_duration_s":0.372114,"scheduling_latency_s":0.372141}2295gitlab # [ 453.666717] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.307Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a9499faed8db475b67bd08a8","created_at":"2026-08-20T06:00:30.893Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.896Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a9499faed8db475b67bd08a8: done: 0.03888 sec","job_status":"done","queue_duration_s":0.372114,"scheduling_latency_s":0.372141,"redis_calls":7,"redis_duration_s":0.002363,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00177,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03888,"completed_at":"2026-08-20T06:00:31.307Z","load_balancing_strategy":"primary","db_duration_s":0.009213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 453.711127] gitaly[911]: time="2026-08-20T06:00:30.888Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=70 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5087 command.oublock=8 command.real_time_ms=96 command.spawn_token_fork_ms=3 command.system_time_ms=51 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:40.006" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:30.786" grpc.time_ms=101.317 pid=911 ref=refs/keep-around/469e5ce4513aa1d1884c5c76cf26249d4cd34009 remote_ip="2001:db8:1::1" revision=469e5ce4513aa1d1884c5c76cf26249d4cd34009 span.kind=server system=grpc username=root2297gitlab # [ 453.726274] nix-daemon[3857]: accepted connection from pid 4546, user nixbot2298gitlab # [ 453.727228] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"ebbcbac8984b47071fd46430","created_at":"2026-08-20T06:00:30.907Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.909Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ebbcbac8984b47071fd46430: start","job_status":"start","queue_duration_s":0.399927,"scheduling_latency_s":0.399954}2299gitlab # [ 453.742806] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.348Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"ebbcbac8984b47071fd46430","created_at":"2026-08-20T06:00:30.907Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.909Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ebbcbac8984b47071fd46430: done: 0.038864 sec","job_status":"done","queue_duration_s":0.399927,"scheduling_latency_s":0.399954,"redis_calls":10,"redis_duration_s":0.003013,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001599,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000792,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000622,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038864,"completed_at":"2026-08-20T06:00:31.348Z","load_balancing_strategy":"primary","db_duration_s":0.008046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 453.786056] gitaly[911]: time="2026-08-20T06:00:30.894Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:00.493" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:30.893" grpc.time_ms=0.291 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2301gitlab # [ 453.798922] nix-daemon[3857]: accepted connection from pid 4556, user nixbot2302gitlab # [ 453.799880] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.350Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3fe34859ef6a47cc218118f0","created_at":"2026-08-20T06:00:30.903Z","trace_propagation_headers":{"sentry-trace":"71fb2fa1c6f7489eb68c3f19cc23a968-ea7c774dd9ac4e93","baggage":"sentry-trace_id=71fb2fa1c6f7489eb68c3f19cc23a968,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3EHZX4V3W7ER32ASCPKP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.910Z","job_size_bytes":65,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3fe34859ef6a47cc218118f0: start","job_status":"start","queue_duration_s":0.440138,"scheduling_latency_s":0.44016}2303gitlab # [ 453.817067] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.385Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3fe34859ef6a47cc218118f0","created_at":"2026-08-20T06:00:30.903Z","trace_propagation_headers":{"sentry-trace":"71fb2fa1c6f7489eb68c3f19cc23a968-ea7c774dd9ac4e93","baggage":"sentry-trace_id=71fb2fa1c6f7489eb68c3f19cc23a968,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3EHZX4V3W7ER32ASCPKP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.910Z","job_size_bytes":65,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3fe34859ef6a47cc218118f0: done: 0.035639 sec","job_status":"done","queue_duration_s":0.440138,"scheduling_latency_s":0.44016,"redis_calls":7,"redis_duration_s":0.0025649999999999996,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002021,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000544,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035639,"completed_at":"2026-08-20T06:00:31.385Z","load_balancing_strategy":"primary","db_duration_s":0.007949,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2304gitlab # [ 453.860672] gitaly[911]: time="2026-08-20T06:00:30.941Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3D28BPMASDCQC9ZTXA5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:01:00.839" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:30.939" grpc.time_ms=2.076 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 453.873348] nix-daemon[3857]: accepted connection from pid 4546, user nixbot2306gitlab # [ 453.874285] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.387Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"51f1864e3ae8e3cadbad2da8","created_at":"2026-08-20T06:00:30.910Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.912Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-51f1864e3ae8e3cadbad2da8: start","job_status":"start","queue_duration_s":0.475074,"scheduling_latency_s":0.475092}2307gitlab # [ 453.892996] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.446Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"51f1864e3ae8e3cadbad2da8","created_at":"2026-08-20T06:00:30.910Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.912Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-51f1864e3ae8e3cadbad2da8: done: 0.058785 sec","job_status":"done","queue_duration_s":0.475074,"scheduling_latency_s":0.475092,"redis_calls":7,"redis_duration_s":0.002746,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000632,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.058785,"completed_at":"2026-08-20T06:00:31.446Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2308gitlab # [ 453.936308] gitaly[911]: time="2026-08-20T06:00:30.974Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3D28BPMASDCQC9ZTXA5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:00.873" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:30.973" grpc.time_ms=1.033 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2309gitlab # [ 453.949383] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.450Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b9c871fb557baa02e6dcb8bd","created_at":"2026-08-20T06:00:30.911Z","trace_propagation_headers":{"sentry-trace":"71fb2fa1c6f7489eb68c3f19cc23a968-ea7c774dd9ac4e93","baggage":"sentry-trace_id=71fb2fa1c6f7489eb68c3f19cc23a968,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3EHZX4V3W7ER32ASCPKP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.915Z","job_size_bytes":65,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b9c871fb557baa02e6dcb8bd: start","job_status":"start","queue_duration_s":0.534501,"scheduling_latency_s":0.534545}2310gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses2311gitlab # [ 453.967483] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.589Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b9c871fb557baa02e6dcb8bd","created_at":"2026-08-20T06:00:30.911Z","trace_propagation_headers":{"sentry-trace":"71fb2fa1c6f7489eb68c3f19cc23a968-ea7c774dd9ac4e93","baggage":"sentry-trace_id=71fb2fa1c6f7489eb68c3f19cc23a968,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3EHZX4V3W7ER32ASCPKP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.915Z","job_size_bytes":65,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b9c871fb557baa02e6dcb8bd: done: 0.139705 sec","job_status":"done","queue_duration_s":0.534501,"scheduling_latency_s":0.534545,"redis_calls":10,"redis_duration_s":0.005007,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002487,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00252,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.139705,"completed_at":"2026-08-20T06:00:31.589Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2312gitlab # [ 454.011931] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.592Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"547659719ea1f3f1fe961cf8","created_at":"2026-08-20T06:00:30.913Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.916Z","job_size_bytes":19,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-547659719ea1f3f1fe961cf8: start","job_status":"start","queue_duration_s":0.676406,"scheduling_latency_s":0.676442}2313gitlab # [ 454.026950] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.638Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"547659719ea1f3f1fe961cf8","created_at":"2026-08-20T06:00:30.913Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.916Z","job_size_bytes":19,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-547659719ea1f3f1fe961cf8: done: 0.045965 sec","job_status":"done","queue_duration_s":0.676406,"scheduling_latency_s":0.676442,"redis_calls":8,"redis_duration_s":0.002919,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002275,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045965,"completed_at":"2026-08-20T06:00:31.638Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2314gitlab # [ 454.067772] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.641Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b3a93fabcfef8742fea943a3","created_at":"2026-08-20T06:00:30.917Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.919Z","job_size_bytes":66,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b3a93fabcfef8742fea943a3: start","job_status":"start","queue_duration_s":0.722264,"scheduling_latency_s":0.722296}2315gitlab # [ 454.086397] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.687Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b3a93fabcfef8742fea943a3","created_at":"2026-08-20T06:00:30.917Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.919Z","job_size_bytes":66,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b3a93fabcfef8742fea943a3: done: 0.0463 sec","job_status":"done","queue_duration_s":0.722264,"scheduling_latency_s":0.722296,"redis_calls":7,"redis_duration_s":0.006639,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005408,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0463,"completed_at":"2026-08-20T06:00:31.687Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2316gitlab # [ 454.129519] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.689Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7eeff605246e28ba584743bb","created_at":"2026-08-20T06:00:30.919Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.921Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7eeff605246e28ba584743bb: start","job_status":"start","queue_duration_s":0.767816,"scheduling_latency_s":0.76784}2317gitlab # [ 454.145628] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.732Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7eeff605246e28ba584743bb","created_at":"2026-08-20T06:00:30.919Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.921Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7eeff605246e28ba584743bb: done: 0.042348 sec","job_status":"done","queue_duration_s":0.767816,"scheduling_latency_s":0.76784,"redis_calls":7,"redis_duration_s":0.0014730000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042348,"completed_at":"2026-08-20T06:00:31.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2318gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses, in 0.19 seconds)2319gitlab # [ 454.188298] gitaly[911]: time="2026-08-20T06:00:31.955Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:01:01.853" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:31.954" grpc.time_ms=1.501 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2320gitlab # [ 454.200921] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 922321gitlab # [ 454.203502] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.744Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"cd2cadf289a50f69ba8eefec","created_at":"2026-08-20T06:00:30.922Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.924Z","job_size_bytes":6,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-cd2cadf289a50f69ba8eefec: start","job_status":"start","queue_duration_s":0.820072,"scheduling_latency_s":0.820098}2322gitlab # [ 454.219545] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.767Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"cd2cadf289a50f69ba8eefec","created_at":"2026-08-20T06:00:30.922Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.924Z","job_size_bytes":6,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-cd2cadf289a50f69ba8eefec: done: 0.023387 sec","job_status":"done","queue_duration_s":0.820072,"scheduling_latency_s":0.820098,"redis_calls":7,"redis_duration_s":0.002133,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023387,"completed_at":"2026-08-20T06:00:31.767Z","load_balancing_strategy":"primary","db_duration_s":0.000968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2323gitlab # [ 454.261493] gitaly[911]: time="2026-08-20T06:00:32.014Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3EHZX4V3W7ER32ASCPKP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:02.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:32.011" grpc.time_ms=2.291 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2324gitlab # [ 454.273884] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.769Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b0de4a1e9e5695d608df4564","created_at":"2026-08-20T06:00:30.924Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.926Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b0de4a1e9e5695d608df4564: start","job_status":"start","queue_duration_s":0.843043,"scheduling_latency_s":0.843064}2325gitlab # [ 454.290329] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.802Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b0de4a1e9e5695d608df4564","created_at":"2026-08-20T06:00:30.924Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.926Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b0de4a1e9e5695d608df4564: done: 0.032631 sec","job_status":"done","queue_duration_s":0.843043,"scheduling_latency_s":0.843064,"redis_calls":7,"redis_duration_s":0.002075,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001457,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032631,"completed_at":"2026-08-20T06:00:31.802Z","load_balancing_strategy":"primary","db_duration_s":0.006905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2326gitlab # [ 454.331305] gitaly[911]: time="2026-08-20T06:00:32.031Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3FZ2YFKCX0H0SMWG9FMW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:02.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:32.030" grpc.time_ms=0.779 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2327gitlab # [ 454.344109] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.804Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"c38cfcdb23c39a8247576c9c","created_at":"2026-08-20T06:00:30.984Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.986Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c38cfcdb23c39a8247576c9c: start","job_status":"start","queue_duration_s":0.817859,"scheduling_latency_s":0.817881}2328gitlab # [ 454.359502] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.840Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"c38cfcdb23c39a8247576c9c","created_at":"2026-08-20T06:00:30.984Z","trace_propagation_headers":{"sentry-trace":"65ef41ddef0f44f0b8f608ca8d2c95d3-79f88efe06cc482c","baggage":"sentry-trace_id=65ef41ddef0f44f0b8f608ca8d2c95d3,sentry-release=Unknown"},"correlation_id":"01M0EW3D28BPMASDCQC9ZTXA5T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.986Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c38cfcdb23c39a8247576c9c: done: 0.035645 sec","job_status":"done","queue_duration_s":0.817859,"scheduling_latency_s":0.817881,"redis_calls":8,"redis_duration_s":0.002386,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001836,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035645,"completed_at":"2026-08-20T06:00:31.840Z","load_balancing_strategy":"primary","db_duration_s":0.007629,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2329gitlab # [ 454.400888] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:31.841Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3aa003b08e171475539cb53f","created_at":"2026-08-20T06:00:30.982Z","trace_propagation_headers":{"sentry-trace":"71fb2fa1c6f7489eb68c3f19cc23a968-ea7c774dd9ac4e93","baggage":"sentry-trace_id=71fb2fa1c6f7489eb68c3f19cc23a968,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3EHZX4V3W7ER32ASCPKP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.986Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3aa003b08e171475539cb53f: start","job_status":"start","queue_duration_s":0.854959,"scheduling_latency_s":0.854981}2330gitlab # [ 454.416563] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:32.031Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3aa003b08e171475539cb53f","created_at":"2026-08-20T06:00:30.982Z","trace_propagation_headers":{"sentry-trace":"71fb2fa1c6f7489eb68c3f19cc23a968-ea7c774dd9ac4e93","baggage":"sentry-trace_id=71fb2fa1c6f7489eb68c3f19cc23a968,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3EHZX4V3W7ER32ASCPKP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:30.986Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3aa003b08e171475539cb53f: done: 0.189727 sec","job_status":"done","queue_duration_s":0.854959,"scheduling_latency_s":0.854981,"gitaly_calls":2,"gitaly_duration_s":0.011272,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011411,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001707,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001191,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.00252,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002028,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000522,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000455,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.136973,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14687474,"duration_s":0.189727,"completed_at":"2026-08-20T06:00:32.031Z","load_balancing_strategy":"primary","db_duration_s":0.040915,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2331gitlab # [ 454.480741] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:32.034Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"12540b93b3f3d2ba87d7c0fc","created_at":"2026-08-20T06:00:31.918Z","trace_propagation_headers":{"sentry-trace":"71fb2fa1c6f7489eb68c3f19cc23a968-72f2c150f20e4738","baggage":"sentry-trace_id=71fb2fa1c6f7489eb68c3f19cc23a968,sentry-release=Unknown"},"correlation_id":"01M0EW3EHZX4V3W7ER32ASCPKP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.921Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-12540b93b3f3d2ba87d7c0fc: start","job_status":"start","queue_duration_s":0.113013,"scheduling_latency_s":0.113042}2332gitlab # [ 454.525077] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:32.224Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"12540b93b3f3d2ba87d7c0fc","created_at":"2026-08-20T06:00:31.918Z","trace_propagation_headers":{"sentry-trace":"71fb2fa1c6f7489eb68c3f19cc23a968-72f2c150f20e4738","baggage":"sentry-trace_id=71fb2fa1c6f7489eb68c3f19cc23a968,sentry-release=Unknown"},"correlation_id":"01M0EW3EHZX4V3W7ER32ASCPKP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:31.921Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-12540b93b3f3d2ba87d7c0fc: done: 0.189438 sec","job_status":"done","queue_duration_s":0.113013,"scheduling_latency_s":0.113042,"redis_calls":7,"redis_duration_s":0.002081,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.175154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.189438,"completed_at":"2026-08-20T06:00:32.223Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2333gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses2334gitlab # [ 455.374385] gitaly[911]: time="2026-08-20T06:00:33.248Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3H3KXVQPG4DQPPPW34DZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:03.046" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:33.247" grpc.time_ms=1.416 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2335gitlab # [ 455.433662] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1682336gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses, in 0.24 seconds)2337gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses2338gitlab # [ 456.601068] gitaly[911]: time="2026-08-20T06:00:34.475Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3J9YZ2ZDJAY4P15D2N5C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:04.173" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:34.473" grpc.time_ms=1.326 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2339gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses, in 0.22 seconds)2340gitlab # [ 456.659258] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1662341gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses2342gitlab # [ 457.820691] gitaly[911]: time="2026-08-20T06:00:35.695Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3KG8FTXN9N3A1QV5R51Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:05.492" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:35.693" grpc.time_ms=1.342 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2343gitlab # [ 457.868962] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1502344gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses, in 0.21 seconds)2345gitlab # [ 458.323483] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"96d46a24cd12fff74a038828","created_at":"2026-08-20T06:00:36.160Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0040c18880733cb7a3abdcf409eef8e1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.191Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-96d46a24cd12fff74a038828: start","job_status":"start","queue_duration_s":0.005899,"scheduling_latency_s":0.005957}2346gitlab # [ 458.478315] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"96d46a24cd12fff74a038828","created_at":"2026-08-20T06:00:36.160Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0040c18880733cb7a3abdcf409eef8e1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.191Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-96d46a24cd12fff74a038828: done: 0.155609 sec","job_status":"done","queue_duration_s":0.005899,"scheduling_latency_s":0.005957,"redis_calls":9,"redis_duration_s":0.015889,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002901,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.155609,"completed_at":"2026-08-20T06:00:36.352Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014209,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2347gitlab # [ 458.569746] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.357Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"d5245d390ab2d90d7ee2f755","created_at":"2026-08-20T06:00:36.217Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5021ce1a3f63cb05fa448c220f00473b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.236Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-d5245d390ab2d90d7ee2f755: start","job_status":"start","queue_duration_s":0.120797,"scheduling_latency_s":0.120845}2348gitlab # [ 458.587356] gitaly[911]: time="2026-08-20T06:00:36.405Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:06.103" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:36.404" grpc.time_ms=1.069 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2349gitlab # [ 458.613403] gitaly[911]: time="2026-08-20T06:00:36.489Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:46.290" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:36.470" grpc.time_ms=18.195 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2350gitlab # [ 458.717634] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2812351gitlab # [ 458.724874] nixbot[3627]: {"ts": "2026-08-20T06:00:36.597Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/469e5ce4513aa1d1884c5c76cf26249d4cd34009 \"HTTP/1.1 201 Created\""}2352gitlab # [ 458.763749] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"d5245d390ab2d90d7ee2f755","created_at":"2026-08-20T06:00:36.217Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5021ce1a3f63cb05fa448c220f00473b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.236Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-d5245d390ab2d90d7ee2f755: done: 0.28087 sec","job_status":"done","queue_duration_s":0.120797,"scheduling_latency_s":0.120845,"redis_calls":28,"redis_duration_s":0.054958,"redis_read_bytes":36,"redis_write_bytes":10593,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004739,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.002245,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8305,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.035103,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.012871,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00329428,"duration_s":0.28087,"completed_at":"2026-08-20T06:00:36.637Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2353gitlab # [ 458.855558] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"61bf6aa19a8ecfaaa66777fc","created_at":"2026-08-20T06:00:36.270Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c46641d9a5544f4d8990fa24c9d23384","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.344Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-61bf6aa19a8ecfaaa66777fc: start","job_status":"start","queue_duration_s":0.308768,"scheduling_latency_s":0.308824}2354gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses2355gitlab # [ 458.874108] gitaly[911]: time="2026-08-20T06:00:36.693Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3MG06BGD55DKJKFD9EJT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:06.391" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:36.691" grpc.time_ms=1.214 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2356gitlab # [ 458.896277] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.767Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2357gitlab # [ 458.907599] gitaly[911]: time="2026-08-20T06:00:36.771Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3MG06BGD55DKJKFD9EJT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:46.170" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:36.750" grpc.time_ms=20.37 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2358gitlab # [ 458.937544] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"61bf6aa19a8ecfaaa66777fc","created_at":"2026-08-20T06:00:36.270Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c46641d9a5544f4d8990fa24c9d23384","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.344Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-61bf6aa19a8ecfaaa66777fc: done: 0.154264 sec","job_status":"done","queue_duration_s":0.308768,"scheduling_latency_s":0.308824,"redis_calls":9,"redis_duration_s":0.037692,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003011,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0253,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009381,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.154264,"completed_at":"2026-08-20T06:00:36.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2359gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses, in 0.14 seconds)2360gitlab # [ 459.005299] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"95809d0aa3a5c5445834df9d","created_at":"2026-08-20T06:00:36.409Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"947c156a460c7b4dd95b884c5fb0063f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.423Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-95809d0aa3a5c5445834df9d: start","job_status":"start","queue_duration_s":0.389528,"scheduling_latency_s":0.389566}2361gitlab # [ 459.025013] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.869Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"95809d0aa3a5c5445834df9d","created_at":"2026-08-20T06:00:36.409Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"947c156a460c7b4dd95b884c5fb0063f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.423Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-95809d0aa3a5c5445834df9d: done: 0.056081 sec","job_status":"done","queue_duration_s":0.389528,"scheduling_latency_s":0.389566,"redis_calls":11,"redis_duration_s":0.008016,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000592,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000246,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003861,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032994,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.056081,"completed_at":"2026-08-20T06:00:36.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2362gitlab # [ 459.074685] gitaly[911]: time="2026-08-20T06:00:36.850Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3MNGX2WKR436FZH8N592 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:06.649" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:36.850" grpc.time_ms=0.583 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2363gitlab # [ 459.088730] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2312364gitlab # [ 459.091289] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses HTTP/1.1" 200 1307 "" "curl/8.21.0" 992365gitlab # [ 459.094111] nixbot[3627]: {"ts": "2026-08-20T06:00:36.841Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/469e5ce4513aa1d1884c5c76cf26249d4cd34009 \"HTTP/1.1 201 Created\""}2366gitlab # [ 459.096976] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.871Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"dbafa1d2f7cea9406c2aed3f","created_at":"2026-08-20T06:00:36.436Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a20e012e99269499d624a4a41c8f8b05","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.471Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-dbafa1d2f7cea9406c2aed3f: start","job_status":"start","queue_duration_s":0.399442,"scheduling_latency_s":0.399474}2367gitlab # [ 459.110475] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.942Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"dbafa1d2f7cea9406c2aed3f","created_at":"2026-08-20T06:00:36.436Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a20e012e99269499d624a4a41c8f8b05","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.471Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-dbafa1d2f7cea9406c2aed3f: done: 0.071008 sec","job_status":"done","queue_duration_s":0.399442,"scheduling_latency_s":0.399474,"redis_calls":11,"redis_duration_s":0.010443000000000001,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001596,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004388,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004459,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0036826,"exclusive_lock_hold_duration_s":0.01946492,"duration_s":0.071008,"completed_at":"2026-08-20T06:00:36.941Z","load_balancing_strategy":"primary","db_duration_s":0.017436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2368gitlab # [ 459.152815] gitaly[911]: time="2026-08-20T06:00:36.929Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3MQNTYM9HS633ZBZWV16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:06.627" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:36.927" grpc.time_ms=1.083 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2369gitlab # [ 459.165663] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:36.943Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"a6aee8a9c245967903f1034b","created_at":"2026-08-20T06:00:36.482Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47883640973b403e283f1431a05d0c8d","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.501Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-a6aee8a9c245967903f1034b: start","job_status":"start","queue_duration_s":0.442036,"scheduling_latency_s":0.44206}2370gitlab # [ 459.180468] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:37.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"a6aee8a9c245967903f1034b","created_at":"2026-08-20T06:00:36.482Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47883640973b403e283f1431a05d0c8d","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.501Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-a6aee8a9c245967903f1034b: done: 0.06719 sec","job_status":"done","queue_duration_s":0.442036,"scheduling_latency_s":0.44206,"redis_calls":13,"redis_duration_s":0.007405,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.006111,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003649,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.06719,"completed_at":"2026-08-20T06:00:37.010Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2371gitlab # [ 459.226671] gitaly[911]: time="2026-08-20T06:00:36.985Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3MQNTYM9HS633ZBZWV16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:46.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:36.976" grpc.time_ms=9.04 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2372gitlab # [ 459.240347] nixbot[3627]: {"ts": "2026-08-20T06:00:37.049Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/469e5ce4513aa1d1884c5c76cf26249d4cd34009 \"HTTP/1.1 201 Created\""}2373gitlab # [ 459.243056] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/469e5ce4513aa1d1884c5c76cf26249d4cd34009 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1942374gitlab # [ 459.245670] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:37.013Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1cf32de1dd284c137e3ef94f","created_at":"2026-08-20T06:00:36.505Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfd64252e997e00d2503d8fa76b21c55","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.519Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1cf32de1dd284c137e3ef94f: start","job_status":"start","queue_duration_s":0.493699,"scheduling_latency_s":0.493729}2375gitlab # [ 459.266345] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:37.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1cf32de1dd284c137e3ef94f","created_at":"2026-08-20T06:00:36.505Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfd64252e997e00d2503d8fa76b21c55","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.519Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1cf32de1dd284c137e3ef94f: done: 0.127131 sec","job_status":"done","queue_duration_s":0.493699,"scheduling_latency_s":0.493729,"redis_calls":11,"redis_duration_s":0.010966,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000623,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008497,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001846,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00140874,"exclusive_lock_hold_duration_s":0.01407986,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.127131,"completed_at":"2026-08-20T06:00:37.140Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.060511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2376gitlab # [ 459.309444] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:37.148Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"35a1a4d909a9665507c8f795","created_at":"2026-08-20T06:00:36.553Z","trace_propagation_headers":{"sentry-trace":"11e41b798d5646c3b59156fd6736a38a-8f183a7a6816495f","baggage":"sentry-trace_id=11e41b798d5646c3b59156fd6736a38a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3M6PFXGFT8GA91MK7SW9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.561Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-35a1a4d909a9665507c8f795: start","job_status":"start","queue_duration_s":0.587553,"scheduling_latency_s":0.58758}2377gitlab # [ 459.325879] nix-daemon[3857]: accepted connection from pid 4614, user nixbot2378gitlab # [ 459.444006] gitaly[911]: time="2026-08-20T06:00:37.319Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3N341YRP6GB3J4G8T22R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:37.305" grpc.time_ms=14.056 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2379gitlab # [ 459.463787] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:37 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1002380gitlab # [ 459.534770] gitaly[911]: time="2026-08-20T06:00:37.410Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:37.409" grpc.time_ms=0.764 pid=911 span.kind=server system=grpc2381gitlab # [ 459.574234] gitaly[911]: time="2026-08-20T06:00:37.449Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3N6BZ4FM2Y5EHNW90ZZG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:37.431" pid=911 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2382gitlab # [ 459.596213] gitaly[911]: time="2026-08-20T06:00:37.450Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3N6BZ4FM2Y5EHNW90ZZG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:37.431" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2383gitlab # [ 459.614077] gitlab-workhorse[817]: time="2026-08-20T06:00:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672384gitlab # [ 459.616343] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1282385gitlab # [ 459.618611] gitaly[911]: time="2026-08-20T06:00:37.453Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3N6BZ4FM2Y5EHNW90ZZG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:37.431" grpc.time_ms=18.866 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc2386gitlab # [ 459.636790] gitaly[911]: time="2026-08-20T06:00:37.463Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:37.462" grpc.time_ms=0.548 pid=911 span.kind=server system=grpc2387gitlab # [ 459.647437] gitaly[911]: time="2026-08-20T06:00:37.516Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:37.515" grpc.time_ms=0.921 pid=911 span.kind=server system=grpc2388gitlab # [ 459.659040] gitaly[911]: time="2026-08-20T06:00:37.522Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:07.257" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:37.358" operations="[repack_refs]" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2389gitlab # [ 459.669998] gitaly[911]: time="2026-08-20T06:00:37.525Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:07.257" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:37.358" pid=911 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-20 05:58:42.34476302 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2390gitlab # [ 459.682586] gitaly[911]: time="2026-08-20T06:00:37.530Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 diskcache=2ee5ab8e-390f-4586-afcd-29e3d9200c51 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:07.257" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:37.358" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2391gitlab # [ 459.692480] gitaly[911]: time="2026-08-20T06:00:37.530Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=143 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6999 command.oublock=0 command.real_time_ms=161 command.spawn_token_fork_ms=2 command.system_time_ms=72 command.user_time_ms=71 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:07.257" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:37.358" grpc.time_ms=172.694 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2392gitlab # [ 459.705879] nix-daemon[3857]: accepted connection from pid 4665, user nixbot2393gitlab # [ 459.706833] gitaly[911]: time="2026-08-20T06:00:37.548Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:07.257" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:37.358" pid=911 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2394gitlab # [ 459.720494] gitaly[911]: time="2026-08-20T06:00:37.548Z" level=info msg="optimized repository" clean_stale_data_time=22.65072ms clean_work_trees_time="111.8µs" commit_graph_time=880ns correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.78µs" pid=911 prune_time=580ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.68µs" storage_name=default system=housekeeping total_time=22.81514ms2395gitlab # [ 459.726306] gitaly[911]: time="2026-08-20T06:00:37.548Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:07.257" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:37.358" pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2396gitlab # [ 459.843102] gitaly[911]: time="2026-08-20T06:00:37.718Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:01:07.616" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:37.716" grpc.time_ms=1.608 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2397gitlab # [ 459.941931] gitaly[911]: time="2026-08-20T06:00:37.816Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3M6PFXGFT8GA91MK7SW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:07.713" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:37.814" grpc.time_ms=1.613 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2398gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses2399gitlab # [ 459.986558] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:37.860Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"35a1a4d909a9665507c8f795","created_at":"2026-08-20T06:00:36.553Z","trace_propagation_headers":{"sentry-trace":"11e41b798d5646c3b59156fd6736a38a-8f183a7a6816495f","baggage":"sentry-trace_id=11e41b798d5646c3b59156fd6736a38a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3M6PFXGFT8GA91MK7SW9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.561Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3608,"job_status":"rescheduled","message":"PipelineProcessWorker JID-35a1a4d909a9665507c8f795: rescheduled"}2400gitlab # [ 460.049219] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:37.923Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"35a1a4d909a9665507c8f795","created_at":"2026-08-20T06:00:36.553Z","trace_propagation_headers":{"sentry-trace":"11e41b798d5646c3b59156fd6736a38a-8f183a7a6816495f","baggage":"sentry-trace_id=11e41b798d5646c3b59156fd6736a38a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3M6PFXGFT8GA91MK7SW9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.561Z","job_size_bytes":3,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-35a1a4d909a9665507c8f795: done: 0.774278 sec","job_status":"done","queue_duration_s":0.587553,"scheduling_latency_s":0.58758,"gitaly_calls":3,"gitaly_duration_s":0.196466,"redis_calls":76,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.088479,"redis_read_bytes":168,"redis_write_bytes":21330,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.004399,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.008232,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.02313,"redis_queues_read_bytes":37,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":20,"redis_queues_metadata_duration_s":0.027639,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3301,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.009454,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003958,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.007268,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.14,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.019,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.066,"db_ci_duration_s":0.075,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.298877,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6127323,"duration_s":0.774278,"completed_at":"2026-08-20T06:00:37.923Z","load_balancing_strategy":"primary","db_duration_s":0.150667,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2401gitlab # [ 460.137883] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:37.932Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"318e24062ac7de0d0974a726","created_at":"2026-08-20T06:00:36.548Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fa5de08266b83ae1ae672096e98594d","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.574Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-318e24062ac7de0d0974a726: start","job_status":"start","queue_duration_s":1.358249,"scheduling_latency_s":1.35831}2402gitlab # [ 460.187093] gitaly[911]: time="2026-08-20T06:00:38.062Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3NTS2RZSQJ5Z5WA22YBB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:08.060" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:38.061" grpc.time_ms=1.2 pid=911 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2403gitlab # [ 460.217150] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:38.067Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"318e24062ac7de0d0974a726","created_at":"2026-08-20T06:00:36.548Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-11015b479fb84eea","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fa5de08266b83ae1ae672096e98594d","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.574Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-318e24062ac7de0d0974a726: done: 0.134868 sec","job_status":"done","queue_duration_s":1.358249,"scheduling_latency_s":1.35831,"redis_calls":10,"redis_duration_s":0.015184000000000001,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003035,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008056,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004093,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00102608,"duration_s":0.134868,"completed_at":"2026-08-20T06:00:38.067Z","load_balancing_strategy":"primary","db_duration_s":0.030103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2404gitlab # [ 460.279390] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:38.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"202c1639774ef28bc5e4f666","created_at":"2026-08-20T06:00:36.516Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-a0492db1abf744a5","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"5021ce1a3f63cb05fa448c220f00473b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.593Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-202c1639774ef28bc5e4f666: start","job_status":"start","queue_duration_s":1.478318,"scheduling_latency_s":1.478377}2405gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/469e5ce4513aa1d1884c5c76cf26249d4cd34009/statuses, in 0.31 seconds)2406(finished: subtest: eval and build post commit statuses, in 7.46 seconds)2407(finished: run the VM test script, in 535.96 seconds)2408gitlab # [ 460.295651] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:38.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"202c1639774ef28bc5e4f666","created_at":"2026-08-20T06:00:36.516Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-a0492db1abf744a5","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"5021ce1a3f63cb05fa448c220f00473b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.593Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-202c1639774ef28bc5e4f666: done: 0.088404 sec","job_status":"done","queue_duration_s":1.478318,"scheduling_latency_s":1.478377,"redis_calls":16,"redis_duration_s":0.00841,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001097,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00239,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004923,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00090168,"duration_s":0.088404,"completed_at":"2026-08-20T06:00:38.159Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2409gitlab # [ 460.338155] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:38.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1f15edf3b3567e12a078aa95","created_at":"2026-08-20T06:00:36.516Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-a0492db1abf744a5","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"5021ce1a3f63cb05fa448c220f00473b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.593Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1f15edf3b3567e12a078aa95: start","job_status":"start","queue_duration_s":1.572155,"scheduling_latency_s":1.572211}2410test script finished in 536.00s2411cleanup2412kill QemuMachine (pid 46)2413gitlab # [ 460.351525] sidekiq-cluster[3608]: {"severity":"INFO","time":"2026-08-20T06:00:38.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1f15edf3b3567e12a078aa95","created_at":"2026-08-20T06:00:36.516Z","trace_propagation_headers":{"sentry-trace":"a53c824b3713404b9c85679c1b61579a-a0492db1abf744a5","baggage":"sentry-trace_id=a53c824b3713404b9c85679c1b61579a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"5021ce1a3f63cb05fa448c220f00473b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.593Z","job_size_bytes":2,"pid":3608,"sidekiq_tid":"m8vk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1f15edf3b3567e12a078aa95: done: 0.039705 sec","job_status":"done","queue_duration_s":1.572155,"scheduling_latency_s":1.572211,"redis_calls":13,"redis_duration_s":0.00472,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001674,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count"qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2414(finished: cleanup, in 1.72 seconds)2415additionally exposed symbols:2416 gitlab,2417 vlan1,2418 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2419[]2420[]2421[]2422[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T05:58:52.843Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2423[]2424[]2425[]2426[]2427[]2428[]2429[]2430[]2431[]2432[]2433[]2434[]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[]2485[]2486[]2487[]2488[]2489[]2490[]2491[]2492[]2493[]2494[]2495[]2496[]2497[]2498[]2499[]2500[]2501[]2502[]2503[]2504[]2505[]2506[]2507[]2508[]2509[]2510[]2511[]2512[]2513[]2514[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '469e5ce4513aa1d1884c5c76cf26249d4cd34009', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T06:00:30.516322Z', 'started_at': None, 'finished_at': None}]2515[]2516[{'id': 5, 'sha': '469e5ce4513aa1d1884c5c76cf26249d4cd34009', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:30.972Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2517[{'id': 5, 'sha': '469e5ce4513aa1d1884c5c76cf26249d4cd34009', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:30.972Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2518[{'id': 5, 'sha': '469e5ce4513aa1d1884c5c76cf26249d4cd34009', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:30.972Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2519[{'id': 5, 'sha': '469e5ce4513aa1d1884c5c76cf26249d4cd34009', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:30.972Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2520[{'id': 5, 'sha': '469e5ce4513aa1d1884c5c76cf26249d4cd34009', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T06:00:30.972Z', 'started_at': None, 'finished_at': '2026-08-20T06:00:36.535Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '469e5ce4513aa1d1884c5c76cf26249d4cd34009', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-20T06:00:36.810Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2521[{'id': 5, 'sha': '469e5ce4513aa1d1884c5c76cf26249d4cd34009', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T06:00:30.972Z', 'started_at': None, 'finished_at': '2026-08-20T06:00:36.535Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '469e5ce4513aa1d1884c5c76cf26249d4cd34009', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-20T06:00:36.810Z', 'started_at': None, 'finished_at': '2026-08-20T06:00:37.016Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]